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THE EFFECT OF OBJECTIVE STANI YARDS UPON 
COMPOSITION TEACHERS’ JUDGMENTS 
EARL HUDELSON 
University of Minnesota 
The whole policy of insisting upon definite standards of pupil 
achievement implies an ability on the part of teachers to deter- 
mine when those standards have been attained. Subjective stand- 
ards of pupil proficiency in English comp: sition are automatically 
disqualified. Finite minds have amply demonstrated their in- 


ability to agree satisfactorily upon standards expressed sub- 
jectively. Objective standards offer difficulty enough; but only 


as they are derived for the various aspects of achievement in 
English composition will standards in that field be meaningful. 

Figure 1 reveals typical conditions under the subjective 
régime. It shows the average percentage scores and the average 
deviations on seventeen compositions by seventeen experienced 
English teachers in the same school who had up to that time been 
satisfied with their ability to judge composition merit subjectively. 
The length of the vertical black lines indicates the average devia- 
tions of the seventeen teachers’ scores from the average score 
of all seventeen teachers. The average scores are shown by short 
solid cross lines. The distance between each pair of dotted lines 
represents the average annual pupil progress in composition. 
The half of the judges who agreed most closely upon the value 
of theme 1 varied on the average 9.8 percent or over four com- 
position years. Variations on several of the other themes are 
almost as great, that on theme ¢ alone being as small as twice 
the average annual pupil progress. These seventeen members of 
the English faculty of one school not only differed significantly, 
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s was found later from the standard of teachers in other sc} 


but they disagreed widely among themselves.’ If these te 


had essaved to classifv the author of theme 5 on the basis 
score on this one theme, his placement would have differ: 
eight years according to two of the teachers and more than 
years according to half of them. 

The chaotic conditions that prevail under subjective stan 


6 9 ie 13 18 15 
Themes 
FIGURE 1. PERCENTAGE SCORES OF SEVENTEEN TEACHERS ON SEVEN 
TEEN THEMES. VERTICAL BARS SHOW AVERAGE DEVIATION 


are revealed again in Table I, which shows the percentage marks 


of ten teachers in the same school on eight compositions selecte 


at random. Theme 7/3 received a percentage score of 40 from 


one teacher and 95 from another. Teacher B would 


0-35, 35-60, 40-70, 70-82, 30-70, 30-60, 0-30, 30-75, 45-80, 30-60, 40-75, 
45-80, 50-83, 50-85, 27-50, and 45-80. 


*The range of scores on each of the seventeen themes was, respectively 
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ced” all eight of these pupils whereas teacher A would have 
sed” only two of them, even though these two instructors 
e at that time teaching different sections of the same com- 
‘on course in the same school. The pupil who wrote 713 
civen by the six teachers who would have “passed” him an 
ize score of 83 percent, while the four teachers who would 
. “failed” him gave him an average mark of 56 percent. No 
nder pupils like to pick their instructors! 
On the percentage scale the average annual pupil improve- 
nt is about 4 percent. On more than half of the themes rep- 
sented in Table I, the average deviation of these ten teachers 


TABLE I. PERCENTAGE SCORES OF EIGHT THEMES BY TEN 
TEACHERS IN SAME SCHOOL 


HERS 
[HEME AVER- AVERAGE 


‘column 13) was equivalent to more than two years OF | upil 


improvement. On theme 7/3 it was equivalent to more than 


three years. On certain themes some of these teachers varied 


from the average judgment of all ten teachers as much as eight 

rs. On theme 713 teacher A and teacher were thirteen com- 
position years apart in their scores in spite of the fact that they 
taught in the same building. This is not a case of a group of 
teachers differing from another group or from a national stand- 
rd: it is a case of wide disagreement among themselves. 

The significant fact about these results is not that those 
teachers were hopeless judges, for practice with objective stand- 
:rds soon revealed that they were not; but that their pupils were 


a 
(1) (2) | (3) | (4) | (5) | (6) | (7) | (8) | 10) (11) (12) (13) 
' 55 | 88/71 80 60 90/86 85 90) 70 77.5 +10.8 
709 70 | 89 | 78 | 90 | 83 | 94 | 85 | 85 92 | 70 83.6 + 6.7 
713 40 | 84/185 76 | 50 | 95 | 82 | 70) 75) 65 72.2 +12.7 
76 80 | 94 75 92 | 80) 88 | 91 | 90 95 | 90 87.5 + §.5 
740 75 | 87 | 79 | 90 70| 70 | 81 | 79 | 8 75 79.1 + §.3 
761 40 | 92 | 72 | 86 | 75 | 92 80 80 60. 75 75.2 +10.8 
762 95|\75 50) 42 | 30 | 45 | 40 | 40 | 30 35 41.2 + 9.4 
794 30 | 75 | 62 | 38 40 45 45 35 5 «640 45.5 + 9.2 
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getting justice under subjective standards, and that it 
ractice in the use of an objective scale to discover the injusti 
What effect do objective standards have upon the ability 
English teachers to agree about composition quality? Figures 2 
3, and 4 reveal the progress made by three teachers in the s 


school in agreeing upon the ranking of ten compositions.? F 


ure 2 shows how widely these three teachers disagreed when th 


ranked these ten themes by subjective standards. It will be noted 


that them / was ranked first by one teacher, fourth by 


other, and last by the other. The standards were so chaotic that 
not even general tendencies are apparent; each teacher wa 
higher than the other two about as often as she was lower 

is obvious in Figure 3 that the use of a scale one month lat 
produced considerably more agreement and decidedly more uni- 
formity. The second teacher was low, but she was consistent; 
* Hudelson, Earl. ‘‘English Composition: Its Aims, Methods, and Mea: 
urement.’’ Twenty-second Yearbook of the National Society for the Study « 
Education. Bloomington, Illinois, Public School Publishing Company, 192 
Part I. pp. 32-34. 
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She could correct her error on practically all themes by 
recting It on one. That is just what she did during the en- 
ng fourteen weeks of practice and conferences, with the result 
wn in Figure 4. 

The writer has invariably found among English teachers that 
n erratic judgment of composition me rit is harder to tame than 
onsistently misplaced judgment is to correct. In other words, 


English teachers find it harder to reduce their variabilities of 
judgment than to correct their systematic errors in judgment 
Figures 3 and 4 show the typical effect of objective standards 


upon misplaced judgment; data following will show that ob- 


jective standards are capable of producing a no less salutary 
effect upon erratic judgments. 

Table I] shows the comparative percentage distribution of 
scores on six hundred themes scored by eight teachers without 
and with the use of an objective composition scale. The scale 
scores tend to conform more closely to the distribution which 
would be expected in heterogeneous class groups such as these 
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were. In every such analysis the writer has found that the use 
of a scale tends (1) to produce more nearly normal distributi 
of marks; (2) to decrease the frequency of superior n 
(3) to shift a considerable number of barely passing mar! 
down into the failure level; and (4) to cause the class med 
to rise at a more reasonable rate. 

This last tendency is shown in Figure 5. Each of 408 puy 


in grades Iv to X11 wrote upon 32 theme assignments during th 


course of one year. Each theme was scored twice by eig 


rABLE Il COMPARISON OF THE PERCENTILE DISTRIBI 


TION 


COMPOSITION SCORES WITH AND WITHO r US OF S 


(OU) CASES ) 


PERCENTILE DISTRIBUTIONS 


Grade VII Grade VIII Grade IX Grade X 


ORES 


Without | With | Without! With |Without) With |Without ) Wit 
ile le ile Seak Seal ‘ Scale 


90-100 18.0 41.2 1.0 8.9 11.6 2.0 22.0 7 
89 36.6 20.0 18.0 2? 0 20.0 26.0 
70-— 79 24.4 22.0 24.0 29.0 20.0 10.0 19.2 12.8 
60— 69 6.3 13.0 13.5 38.7 15.7 16.8 11.1 15.2 
50- 59 


40 5.3 5 £2 

30—- 39 9 10.7 2.1 2.1 5 3.0 0.0 

20-— 29 3.3 2.3 1.2 7.3 2.0 0.0 
10— 19 0.0 0.0 / oe 0.0 0.0 0.0 0.0 0 
Oo ) 0 0 0 


teachers working independently, first on a percentage basis and 
later with the use of an objective scale. Figure 5 shows the 
median judgment of the eight teachers on each scoring. It seems 
reasonable to expect improvement in composition upon the part 
of some of the pupils during each school year. Except for a 
slight negative acceleration while pupils are passing from a lower 
school into the next higher and becoming adjusted to the new, 
it would seem reasonable to anticipate comparatively uniform 


progress. If the percentage curve in Figure 5 is reliable, ther 
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er children in grades vil and x1 lost some composition abil- 
which they had already acquired or there is consistently poorer 
hing in certain years. It is hardly reasonable to expect pupils 

remain in school to backslide in their ability to write, and 


is no cause for believing that all poor teaching gravitates 


FIGURE 5. MEDIAN JUDGMENT OF EIGHT TEACHERS ON THEMES 
WRITTEN BY 408 PUPILS. SOLID LINE REPRESENTS SCALE 
SCORES; BROKEN LINE REPRESENTS PERCENTAGE SCORES 


ard particular school grades. Progress in terms of scale 
res in Figure 5 more nearly approximates expectancy 


Upon refinement of judgment Figure 6 shows the effect 


‘aused by practice in using a composition scale. It represents 


the experiences of 157 English teachers whom the writer trained 


to use an objective composition scale. As many pupil themes 
f unknown value were provided as there were teachers in the 


Theme 

Values 
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four hours with scale 


0.77, two hours with scale 


+ 1.13, percentage score 


+ 1.22, after merely reading ecal 


FIGURE 6. THE EFFECT UPON RELIABILITY OF PRACTICE IN US 
THE HUDELSON TYPICAL COMPOSITION SCALE. 157 JUDGES 
AND 157 THEMES 


practice groups. Each group, ranging in size from 28 to > 
scored the papers in round-robin fashion. Before the scale 
introduced each teacher scored the themes in terms of percents 


Next the teachers read the composition scale silently and then 


scored the themes by it. At the third meeting the scale was ™ 
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i by the instructor and discussed by the group, after which 


chers, always working independently, scored the themes 
After four, six, and sixteen hours of reading, discussion, 


e pra tice the teac hers rescored the themes \iter eat 
¢ the instructor colle cted the score sheets, and the teachers 
isked not to communicate any scores which they remem- 
d having given. They were not told the true values of the 

< until after the scoring which followed sixteen hours of 
tice 
e improving or not. It is reasonable to expect that improve- 


They were given no clue as to whether their judgments 


would have been more rapid if a clue had been given; but 
“blind” procedure was followed in order to counteract the 
t of their remembering how they had scored a theme 
usly. 
The heavy black line in the middle of Figure 6 represents the 
average value of the themes which were scored. The brace 
left spans the average annual amount of pupil-progress in 
position. The distance from the middle line to the second 
rizontal line from either end represents the average of these 
7 teachers’ average deviations from the true scores when they 
d the themes on a percentage basis. Half of these teachers, 
vill be seen, scored these themes over five years above or below 
true values. The deviations were even greater immedi- 
y after the teachers had merely read the scale. Two hours 
-actice with the scale, however, brought them over a 
closer to the true values. Four more hours of practice 
sht them a half-year closer, and two additional hours 
ught them another composition year nearer the actual val- 
- After the sixth hour of practice their rate of improve- 
ment in reliability decreased rapidly; but with only sixteen hours 
{ “blind” practice these teachers, w ho had had no previous ex- 
rience with objective composition scales, were, on the aver- 
re, scoring themes within a composition year of their true val- 
s. They were from two to five times as reliable in their judg- 
nts as are English teachers the country over who use only 


subjective standards. Rate of improvement would have de- 
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creased still more with each additional hour of practice; 
there is ample evidence here to justify the use of objective s 
in scoring compositions and to show that ability to use such 
with reasonable precision is not a forbiddingly slow process 
Composition scales, then, tend to refine judgment as we! 
to stabilize it. They perform the paradexical function of ret 
ing judgment both more constant and more amenable to imp: 
ment. Moreover, they tend to give teachers a more modest 
ion of their ability to judge composition quality. Upor 
using objective composition scales many teachers hold the 
exalted estimate of their powers of discrimination that they 
about their ability to measure composition merit subjecti 
They insist upon giving themes such absurdly nice scale 
as 5.68 or even 5.681. It is at first a disconcerting but eventu 
a wholesome revelation to them to discover that only thre 
of four trained judges can detect the average amount of 


improvement in writing over a period of two-and-a-half 


They come to appreciate that progress in such a complex a 
plishment as composition is very slow and that they need 
chafe if their results over a single year seem to be meager. T! 
do not seize upon this fact as an alibi for poor teaching, | 
ever, for they realize that they will have to teach at top 
to produce even this slight progress. What is even mor 
portant, teachers who learn to use objective composition s 
realize that they have not been measuring their words when th 
declared that one pupil theme is ten times, or even twice, as g 
as another pupil theme. As soon as they come to compreh 
the zero point of composition merit and to see concrete san 
of multiple units of value they appreciate the fact that their 
mer estimates of differences may have been exaggerated 
discover that Thorndike was right when he contended® th 
The paragraph writing of pupils in our high schools and t! 
the world’s hundred best English writers undoubtedly overlap cor 
ably in merit. . . . In the judgment of high-school teachers of Er 
he worst tenth of paragraph writing of high-school pupils is 
* Thorndike, E. L. ‘‘ Notes on the Significance and Use of the 
a7 Journal, 2:551-61, November, 1913. 
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vard the best the world knows What we rightly 


from zero tov 
nts nearly three-fourths of 


mediocre composition still repres¢ 
rress possible The world pays et us sums in money 


for a difference so small that one rson out of four cannot 


me 


values which accrue from the ust of objective comp sition 


ds are. on the whole, greatest for teachers whose powers 


rimination are already most refined The writer has gener- 
und that the composition judgment of those English teach- 
subjective standards are most reliable improves most 
This was clearly 


nose 
istest in practice with objective standards. 
strated, for instance, by the English teachers of Central 
h School, St. Paul. For two years these teachers carried on 

paign to reduce variation in their subjective estimates of 
l-composition merit. At the end of that time their ability 
cree was almost uncanny. Their first attempt to score by 
hiective standard was no better than that of other teachers; 


after five-and-a-half hours of practice with a scale they 


in practical agreement. 

There is evidence that ability to use general merit composi- 
scales reliably is a fair measure of the same factors of in- 
ence that our mental tests now measure. The writer ascer- 


d the intelligence quotients of 91 English teachers. After 


had practiced four hours in using a composition scale their 
correlated with their intelligence quotients 
‘ractice with the scale the 


rage deviations 
9. After sixteen hours of “blind” 
ficient of correlation was — .73 
It would seem, then, that practice in the use of objective 
in English composition renders 


standards of pupil achievement 
teachers’ judgments more accurate and constant at the same 
that it makes them more receptive and sensitive to refine 
It enables teachers to classify pupils more confidently 

to detect composition improvement more reliably, and ap- 
rs to give English teachers moral support in assigning marks 
tly The use of objective measures tends to have a rational- 
influence upon English teachers, often revealing to them 
resumptuously high opinion of their powers of discrimination 
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exaggerated sense of differences in composition 
and curbs erratic judgments as well as corrects consistent « 


f judgment. Reliability in the use of objective cor 


scales furnishes some indication of intelligence. Teachers wh 


accuracy on subjective standards of composition quality is 
est generally learn to use objective standards most rapid] 
reliably 

The quality of the available composition tests and the 


bilities which these objective standards offer for imp 


English teachers’ ability to measure pupils’ composition achi 
ment are out of proportion to the use that is being mad 
them. We wear braces of various sorts to support weak b 
structures; we plague the grocer for the use of his scal 
scare our indulgent wills or pampered appetites into subjugat 
we rely upon all sorts of devices for reinforcing our treac! 
ous memories; but we hesitate to employ methods of sup 
ing, reinforcing, and refining our perfectly normal fallibiliti 
and limitations of human judgment. The use of objective 
vices in education is a contribution to meaningful standardiza 
tion and is a step in professional self-improvement which 
group of teachers can take and which sooner or later every 
fessionally minded group will take. There are already e1 
open-minded teachers receptive to scientific means of social « 
trol to assure the success of educational measurements, whet! 
the rest embrace them or not. All of the early remonstrances 
against the automobile availed nothing; automobiles came any- 


way because they afforded an improved means of social control 


So will objective educational measurements come anyway; 
like the automobile, they will divide humanity into the quick 


the dead. 


340 
Fol 
nd, l 
and 


A PLAN OF CLASSIFYING PUPILS 
E. D. PRICE 
Superintendent of Schools, Enid, Oklahoma 
1918 the authorities of the Enid’ public schools became 
sted in the idea of the classification of pupils ace rding to 


ntal ability. The superintendent set himself the task of plan- 

for the necessary instruction of the teaching force and the 

d reorganization. Two years were occupied in prepara- 

and during the time every teacher in the school system 

me proficient in the use of individual mental tests. All pupils 

srades 1 to 1X were tested by the Stanford Revision of 

Pinet-Simon Test; those from grades IX to XH, by group 

The entire plan of preparation and org nization was pub 

iched in a bulletin by the Board of Education of Enid in 1921.° 

‘ince the Enid plan of clasification has been operating for three 

s, it is now possible to present some statistical facts and some 

rvations that should throw additional light upon the general 

tion of classifying pupils according to ability. Some changes 

e been made in the original scheme of grouping. ‘Two junior 

hich schools have been added, changing the system from the 

ht-four to the six-three-three plan. All teachers® who are em- 

ved now are required to know how to test with the Stanford 
‘<ton of the Binet Test before entering upon their work. 

\ complete retesting has not been made, but all pupils new to 

system are tested after trial in the schools. Retesting of 

some pupils has shown that those with low intelligence quotients 


isually test lower at each successive period. The group names 
conservative estimate Enid has now a population of more than 
sand people The nature of the community has not changed for 
ral years, and similar results might be expected in any growing city 
p D The Enid Plan of Classificat of Pupils According to 
Enid, Oklahoma, Board of Education, 1921. 12 pp 
‘That the teachers all favor the Enid Plan is evident from the answers 
questionnaire sent them by a student at the University of Oklahoma who 
s gathering data for a Master’s thesis. Every teacher expressed unquali 
i approval of the plan, some going so far as to state that they would teach 
Enid for a smaller salary rather than in a system not having a similar 
lassification plan. 
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have been changed from Group I, Group II, and Group [1] 
they were first called, to Vocational Group, Rapid-\W 
Group, and Average Group. 

In the present six-year elementary school the Average G 
and Vocational Group progress by the scheme proposed i 
tentative plan. In Table I the scheme is represented for t! 
mentary school in terms of Elapsed Time in School and | 
grades completed. The average pupils cover six grades ir 
years, while the vocational pupils do four grades in th 
TABLE I. THE GRADE PROGRESS OF THE THREE GROUPS T 

THE ELEMENTARY SCHOOL AS SHOWN BY YEARS IN SCit 

Elapsed Time in School—Years 
3 | 6 
Promoted 


Rapid-W orking VI to 
Group J H ~ 


Average Group 


Vocational 


length of time. The “rapid workers” now do the first th: 
vears of the average course in two years and then join the 
age workers” and keep step with them in grades Iv, v, and 
The one-year acceleration of these pupils makes the avera 
fourth, fifth, and sixth grades difficult enough to keep th 
busy. These accelerated pupils, however, are always the lead 
when grouped with older average pupils. 

In similar manner the progress by grades in the junior ar 
senior high schools for the three groups is shown in Tabk 
Progress is also expressed by the years of Elapsed Tin 


School. In the jumior high school, grades vu, vim, and Ix 


rapid-working pupils may gain a half-year by completing 
years’ work in two and one-half years. In the senior high sc! 
the rapid-working pupils occupy the three years doing three year 
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work. This group gains one year in the elementary school a: 
half a year in the junior high school, a total gain of one 
one-half years over the twelve years needed by the Average G: 
to ¢ mplete the twelve grades of the public school. The V 
tional Group finishes grade x in twelve years. 

Of the total enrollment in the schools of Enid, 7 percent 
classified in the Rapid-Working Group which tncludes pupil 
ing I.Q.’s of 110 or above; 80 percent are in the Average Grou; 
and 13 percent, those having 1.Q.’s of 90 or less, are in the V 


tional Group. The proportion allowed for the last grou 


TABLE III. COMPARISON OF THE PERCENTS OF PUPILS PROM! 
RETAINED, AND DROPPED DURING THE SCHOOL YEARS 
1918-19 anp 1922-23 


| 1918-19 1922-23 
Grad Percent Percent Percent Percent Percent Per 
Promoted Retained Dropped Promoted Ret Lined Dro; 


I 76 15 7 RS 10 2 
II SO 17 97 3 
Ill S4 13 3 o4 3 
IV 82 15 3 o4 5 
V 75 20 6 94 3 
VI 78 16 6 93 t 
Vil 81 12 6 92 3 
Vill 76 8 16 92 t 2 
slightly more than its actual enrollment, because it does not 


clude all the children in town who have intelligence quotient 

below 90. A few have left school and in the lower levels 

included the feeble-minded children who do not attend sch 

Because of the large enrollment of the average pupils, this gr 

in each grade of the junior high school is divided into sul 

groups of 35 pupils classified by ranking the best thirty-five 

the first subgroup, the next best in a second subgroup, and s { 
The curriculum of the elementary school is similar for t! 

three groups. The course of study for the Rapid-Working G 

in high school is more limited in electives than is that of t! 

Average Group, but the former group is given more training ' 

research. Vocational pupils are guided most carefully in thet 
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n in suiting the work 


sulted in success 
pupils 

dur 
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promotions a responding decreast 


HIstorRy OF 1 Ra ORKING GROI 
September, 1921, a group upils having high intelli 


showing exceptional ability in their work 


quotients and 
of Enid Hig : ol. The number entering 
fty-six and the number finishing the year was fifty-four 
two who did not finish the first year | ft 


ns as wage-earners. During the next summer vacation 


the group moved away so that only fifty entered in 


922.  Fort¥-nine finished the year’s work, one hav- 


be ] 
pped out during the year because of ill-health. Tw 
coved awav during the following summer vacation, and 
ven entered the following autumn. One pu] il moved 
during the year, leaving forty-six who graduated from th« 
ce four-year course at the end of their third year in school 
- group of rapid workers entered in 1922 and a third 
Although they covered more subject-matter thar 
erage pupils, the ir marks were in the upper ten percent oO! 
One teacher of history made an investigation to s 
the rapid workers were retaining the facts learned as well 
average workers who were going slower. At the middle « 


her M thes 


boys and 


hat the advantage of giving all v 
as other advantages of the Enid Plan, is evide 


PLAN OF CLASSIFYING PUPILS 15 “ 
| 
, > them vwch tr ini is the y Cal 
nd t-matter in order to give them sucn tral ra 2 
This irticl does not propose ell in detail the subject 
eems worth while to add 
- studied by each group, but 1t seems wort & 
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year, the rapid workers had covered two-thirds of th 

nd the average pupils, one-half. An identical test, covering t 
first half of the text, was given to both groups. The 1 

rkers averaged over 5 points higher on the test, sh 

irkably better insight in the interpretation of the fact 
history. The investigation made with the history groups is 1 
cal of results all through the schools. The rapid workers 
do the three primary grades in the first two years always n 
the highest marks in the fourth grade. Nor does covering 1 


ct-matter in the junior high schools lower their rati 


History OF THE VOCATIONAL Group 


In September, 1921, the first vocational group entered 
high school which included at that time grades 1x to x1. In tl 
first group there were thirty pupils. Twenty-seven finished t! 
st vear: twenty, thi second vear: and seventeen, the 
vear. Of the thirteen who had left school, five took emp! 
ent, as they were encouraged to do when a favorable positi 
was offered. Four left town, and four were out but not regu 


vy employed 


\nother group of vocational pupils entered in September 


1922. There were thirty-seven of them. Thirty-one finish 
first year and twenty-four, the second. Of the thirteen 

; group out of school eight moved away, four are now r 

employed, and one is not. 

Although vocational pupils are guided into suitable cours 
they have some choice in their selection. The first year, for & 
periment, they were permitted to try some of the academic w 
In 1921, members of the group were enrolled in eighty-nine ' 
tional subjects and passed in sixty-nine of them. In 1922, th 
took seventy-eight vocational subjects and passed in sixty-eigh! 
In 1921, they were permitted to enroll in twenty-nine academi 
subjects and passed in seven of them. In 1922, they enrol 
in only three academic subjects and passed in but one. It 
interesting to note that the vocational pupils soon learned to a\ 
the academic work and to select subjects suitable to their capacity 


. 7 
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1923 _ after a vocational group had been doing vocational 


‘two years in senior high school, some of the teachers 


hat ‘with their advanced age some of them might be able to 


egular first-year work. Seven pupils were chosen who 

wed most ability and promise. The records of these five 
nd . girls enrolled in first-year academic subjects fol 
75 is the passing mark in the high school) : 


Paul—C. A., sixteen years, one mot th; I.Q., 89; took algebra, m } 
irk of 90; ancient history, 75; manual training, 84; Englist 
Lvle—C. A., eighteen years, fir months; I.Q., 78; took zoology, 

» a mark of 82; commercial law, 05; commerce! ll Engh 

Anna—C. A., sixteen years, nin¢ months; 1.Q., 72; tool 

a mark of 95; Bible, 80; ancient history, 80; E: 
Mary A. sixteen vears, eight months; 
Bible, 87; anciet 


onard—C , seventeen years, th 
ark of 93; 
rv. 
Willi: C. A., eighteen years; )., 89; t ok geometry, making 
itk of 973 general science, 75; history, : 
Burton—C. A., fifteen years, seven mon ] took algebra, 
a mark of 73; manual training, 81: ancient history, 77; 
} 
Sil, UO 
These marks show that some pupils of rather low intelligence 
reaching a more mature age, Can accom] lish the regular 
tk for beginning pupils in high school. Whether it is advan- 


us for them to take up the reg ular line of work is doubt- 


Nevertheless, this arouses speculation, for the results show 
hat pupils having lower intelligence quotients can be held i 
hool until some of them can make passing marks in a wine ur 


il 


This has not been true under the old plan of the “sur 


of the fittest.” 
Steps TO FoLLow IN CLASSIFYING PupiLts ACCORDING 
» ABILITY 


The experience gained in thus classifying pupils according to 
bility should be of value to others who are contemplating a 


so satis 


ilar piece of work. The steps t taken have | rroved 
ory and the results, including the good feeling between the 
rents and the school authorities, are so favorable that there 


I 
ot 
] 
u 


ere” 
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sitation in describing the procedure for such ber 
derive from tt 
1. The superintendent should study statistics and then 1 
lf intelligently acquainted with scientific measure 
2. With charts, tables, and whatever else is usei 
intendent should C1VE 1 series of lectures to his t 
wey understand his plans and are eager t ssist 
king 
he newspapers should be furnished with plain « 
cts, sl wing that all pupils are not able to d 
f equ mount or quality; emphasizing the handi 
ture’ in school and the danger of holding intelligent | 
back; and telling what other schools are doing to o1 
these handicaps by intelligent classification 
he teacl s should be t: ught to 1 the i 
5. At the end of the first semester of a school year, 


should be a check-up of the conditions in each room of th 


entary and junior high schools. Since the senior high-s 


pupils ar seles | group under traditional organizati 
bably well to omit testing them at this time. After it is 
that many pupils will fail because of inability to accomplis! 


work, discuss the matter with the parents and give the: 


choice of having the pupils fail and repeat the work, or 
promotion at the end of the vear in work they can accor 


We have found it best always to consult with parents be 
placing a child either in the Vocational Group or in the R 
Working Group 

6. Reclassify pupils according to the teacher’s judgn 
he teacher in charge of each room should then test the 
with individual mental tests, one each evening or morning 
have obtained the best results by having each teacher test 
own pupils. Achievement tests should then be given and 
results considered. 
7. Make all necessary readjustments and proceed wit! 
new schedule prepared for the system of schools. 

8. Make the results of the classification according to 


frequently known through the local newspapers. 


t] 


[INIMUM ESSENTIALS IN REPORTING DATA ON 
STANDARD TESTS 
G. M. RvucH 


State Unwwerstty of Iowa 


With the increasing number of educational and n ental tests, 


lready bewildering situation is daily becoming more aggta 

iw The writer refers particularly to the task of the super- 
dent, director of research, and the college teacher of tests 

| measurements, who is confronts d with the problem of select- 
ng and recommending the “best” test to use ven if the cards 
ere all on the table, the selection of the “best” test would pre- 
nt grave difficulties These decisions must be made, and are 
« made daily, but it is an open question whether any living 
ng possesses the exact knowledge required to make suc h deci- 


iil 


ions in anything approaching a scientific matter. Where does 


i 


difficulty lie 
The blame, to use a harsh term, lies primarily with the test 
thors, secondarily with the publishers of tests, and finally, to 
me extent, with the users of tests—the relative culpabilities 
showing wide individual differences W ithin these groups. 
The logic of the” situation, viewed broadly, would seem to 
and that two things be done at once first, that a of 
rking criteria for test construction be esta tblished—and much 
eress has been made on this point; and second; that test 
uthors, test publishers, test users, and test investigators adopt 
me fairly uniform practices in reporting on tests, at least to 
extent of a few minimum essen tials. xcept in isolated 
this has not been the regular pr: actice. Although the sec- 


nd of these points is the primary co sideration of this paper, 
will help to clarify matters. 


few statements about the first’ 


‘Kelley, T. L. ‘¢The Reliability of Test Scor s,’’? Journal of Educational 
search, 3:370-79, May, 1921 
Monroe, W. 8. The Theory of Educational Measurements Boston, 
ighton Mifflin Company, 1923. pp. 182-251. 
McCall, W. A. How to Measure in Education New York, Macmillan 
‘ompany, 1922. pp. 195-410. 
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mands high reliability. 
lutely essential: 
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CRITERIA FOR EVALUATING TESTS AND MEASUREMEN? 


V alidity—the general worth or merit of the test—A di 
tion of the validation of a test may well include such fa 
the following: 

1. The criterion against which the test was validated: ar 
sis of courses of study, analysis of textbooks, recommendat 
of national educational committees, experimental studies 
example, word counts, analysis of social needs), age or g: 
rise in percent of successes, judgments of “competent” pers 
correlation with an outside or independent criterion, or, m« 
“armchair analysis” and “insight.” 

2. Statement of the exact details of all experimental 
leading to the final forms of the test. 


3. Statement of the diagnostic powers of the test, if an) 


4. Statement of the exact field or range of education: 
mental functions for which the test is claimed to be valid 


5. Statement whether the test is adequate for class m« 


urement or pupil measurement. (This is largely a matter 
reliability. ) 

6. Statement relative to equality of forms and how gu 
teed. The same applies to equality of variabilities, namely, 
standard deviations for same groups. 

7. Statement of the degree of correlation of the test 


the criterion, or with school success, age, etc.; or statement 


the agreement of test scores with the attainments of groups « 
individuals known to be widely spaced upon a scale of abilities 
8. Statement of the functions which the test can legitimately 


claim to serve, for example, prognosis, sectioning of classes, 


signment of official grades, determination of passing or failing 
efficiency of instruction. 
These should be accompanied by summaries of the experi 
mental evidence. 
Reliability—the accuracy with which the test measures. 
This is independent of its validity, although high validity d 


Such facts as the following are abs 


11 
tl 
| 
| 
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Reliability coefficients which are usually to be determined 

rrelation of similar forms. These are, however, practically 
ningless unless accompanied by statements of: (1) the range 
talent involved in the determination—best stated in terms of 
standard deviation of the test scores; (2) the population in- 
ed in the determination of the r’s; (3) the age or grade 
ups involved and any evidence leading to judgments of the 


unts of selection or systematic tendencies, or other factors 
ilitating against the representativeness of the sampling; (4) the 
der of giving the forms of the test; and (5) the mean scores 
n each form. These facts should be given in sufficient detail 

permit a second investigator to reproduce the essential con- 
litions of the experimentation at will. 

2. Certain derived measures, which are relatively independ 

of: (1) the range of talent employed and (2) the arbi 
trariness of the test units. 

Ease of administration and scoring.—The following facts 
might be given: 

1. Degree of objectivity of scoring. This influences mar! 

lly the reliability, and hence, the validity of the test. 

2. Time for giving. This is of minor importance without 
supplementation by other facts, the popular opinion to the con 
trary, notwithstanding. The proper criteria should be: Valid 
ity per unit testing time, reliability per unit testing time, or some 
similar point of view. 

3. Time needed for scoring. This is best stated in terms 
of the average number of papers scored per unit of time. That 
this is of secondary importance is shown by the fact that com- 
paratively few standard tests exceed the ordinary written exami- 
nation in the time or labor of scoring. 

4. Simplicity of directions for pupil and examiner. 

Vorms.—This should include: 

1. Kinds of norms available (age, grade, percentile, mental 

ge, T-scores, etc.) 

2. Statement of derivation of norms. This should cover, 
pecifically, facts like those listed under “Reliability” above. 
The important thing is the representativeness of the sampling, 


> 
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not the size. Norms on one hundred thousand cases are not ; 
essarily as accurate as those based on ten thousand, or ever 
thousand cases. /he validity of a norm is not determined 
probable error, but by the principles and laws of sampli) 
served or violated. Norms, at best, are doubtful devices :* 
blind faith in numbers approaches “hocus pocus” at times 
most important thing which a test can do is to place ti/ 
in accurate rank positions along a scale of true ability. The 
mon practice of pooling test-score tabulations voluntari 
turned to the author, without a scrupulous program f 
elimination of the almost inevitable selection effects incid 
this procedure, is particularly to be regretted. 

Cost.—This has little or no theoretical interest but ts 
practical consideration. The cost per pupil is practically 
less unless other facts are weighed. Validity per unit 


re 


the criterion to apply. <A test may be a poor investment ; 
cent per pupil, while a second test would be cheap at ten 


per pupil. Costs of test vary with (1) the cost of experi: 
work (to the writer’s knowledge, the variation on this 
ranges from less than $100 to at least $10,000), (2) quality 


printing, (3) length of test—a very important factor in validit 
and reliability, and (4) profits to publisher and author 


With respect to ail of the before-mentioned desiderata, : 
act procedure can or need be recommended. It is merely 
“spirit of the game” that is fundamental. There is, however 
very important question to be asked, Where should the above d 
be published? The best place, theoretically and practically, 
in the manual of directions accompanying the test. This « 
well be expanded to four, ten, or even one hundred pages 
next best procedure is probably that of publishing abstracts 
the complete description of the test in the manual of directions, 
reserving the details for articles in the standard journals or 
publication in a separate monograph. The important thing 1s r 


*See Chapman, J. C. ‘*Some Elementary Statistical Considerations 
Educational Measurements,’’ Journal of Educational Research, 4:212-20, Oct 
ber, 1921 for an excellent treatment of this question, and Manual of Dwectwr 
Stanford Achievement Test, Revised Edition; particularly the Appendix 


ents 
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full accounts be made accessible to the critical user or stu- 
f tests. To the user of tests should be extended the priv1- 
of choice with open eyes, namely, with the “cards all on 
table,” to repeat an earlier statement. 
lf space permitted, the w riter could at least entertain the 
ler by quoting numerous replies received from authors of 
ndary-school tests in response to an appeal for such data as 
heen outlined. Parenthetically it might be stated that fully 
percent of test authors had made no sy stematic or critical 
of their tests, and not a few did not comprehend the con- 
‘onal test terminology. One responded to a question about 
liability of his test: “This is not an intelligence test.” The 
rrespondent must have been amazed at the writer’s naivete in 


ecting an educational test to possess reliability at all! 


THe REPORTING OF RELIABILITIES OF TrEst SCORES 


(he remainder of this discussion will be devoted to a single 
of the criteria listed for the evaluation of tests, namely, 
y. Attention is directed to this topic partly because of 
importance and partly because the data available on it are 
dingly meager. ‘There has been a wide variety of practices 


reporting test reliabilities—when, indeed, such have been 


rted at all—as follows: 


1. The reliability coefficient r,, 
2. The probable error of timate; P.E.,., = 0.6745 0, V! 
The probable error of measurem nt,” P.E. y = 0.67450 V1 
where 
> 
The index of reliability, r 
P.E 
M 


2 


" where the P.E., is given by formula 


"See any standard textbook on statistics. 
‘Monroe, W. S. The Theory of Educational Measurements. Boston, 
chton Miffin Company, 1923. pp. 206 ff. 
‘Monroe, W. S. A Critical Study of Ce rtain Silent Reading Tests. Ur 
, University of Illinois, 1922. pp 92 ff. (Bureau of Educational Re 
h, College of Education, University of Illinois Bulletin Vol. XIX, Series, 
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M is the mean of the distribution of scores, and, pre: 


M,+M, 
2 
6. The probable error of estimate of a true score by means of g 
single score of the same function, 


PLE 


I.xamination of the six procedures just listed will s! 


equals, 


0.0745 
once that every one, except the first, in part, calls for two 
mental facts, namely, (1) the reliability coefficient; and (2 
standard deviations of the two distributions. 

To these must be added, at least (3) the population on \ 
is based in order to calculate the probable error of » 
The following are most desirable and probably should aly 
be reported: (4) a verbal description of the kind of talent 
volved in the calculation of r, for example, age or grade gr 
kind of school, and possible selective factors militating ag 


Tio 


the representativeness of the sampling; (5) the mean scores 

the two distributions leading to r; (6) the order of giving th 

tests’ and the conditions under which the testing was carried out 
It is greatly to be regretted that one further recommend 

is not always practicable, namely, (7) the publication of the s 

ter diagrams for all r’s reported—this for its bearing on the | 


of rectilinearity of the regressions and the possibility of faulty 
grouping. Both of these factors lower greatly the obtained » 
ares comparison with the truth of the relationship. 

Returning to our statements of the various methods of treat ie 
ing the reliability of test scores, it will be seen at once that « 
list of needed facts more than covers the needs of any or 
the six procedures, in fact, points (1) and (2) alone will sui 
for the purely computational procedures. Granting this, th 
task of estimating the reliability of a test still would be a bit 


‘Kelley, T. L. Statistical Method. New York, Macmillan Company 
1923. p. 212 ff. 

"Because the order of giving the tests must necessarily be different for 
the determination of reliability coefficients than for the investigation of e& 
lence of difficulties from form to form. For the first purpose, all pupils 
should take the tests in the same order, e.g., Form A followed by Forn 
for the second purpose, one half of the group should take Form A first ar 
half Form B first. In the first case we want the practice effects | 
systematic, in the second, they should tend to be neutralized. 
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“leap in the dark” without the subsidiary data outlined in 


- (2) to (7), inclusive. 


is rather beyond the scope of this paper, and beyond the 


of any one of the six proposals However, certain of these 


the writer as well, to demonstrate the absolute superi- 
grave defects that must be made apparent in the interests 
‘heir abandonment for the purpose. The six methods will 


mmented on briefly in turn. 
Is THE Best METHOD OF Test RELIABILITIES: 


rhe first method, the reliability coefficient, can be held to be 
st valueless, per se, for two reasons: 1) it is a function 
the range of talent (¢) and hence has no general stability, 
2?) alone, it tells nothing about the behavior of the individ- 
re. For Examiner A to report ry, as 0 85 for Test X and 
miner B to report 0.64 for Test Y, does not at all imply that 
X is more reliable than Test Y. It would depend upon 


range of talent employed. Assume the following facts for 


Test X Test Y 
0.85 0.604 
Group tested 500 pupils 500 pupils 
(Grades (Grade vI only 
Standard deviation 40.4 10.1 
\y readily be shown that Test Y, if applied to the group to 
hich Test X was given, would show a reliability coefficient in 
neighborhood of 0.98.* 
The needed measure of reliability must be independent, in 


part, of the influence of range of talent. The reliability 
cient, as we have seen, is not. The practice of reporting 


~ 


unsupported by other facts should be discontinued. 


The second proposed measure is the probable error of 


i 


Statistical Method. New "ork, aemilian Company. 


It is assumed that both tests are sealed to the same units. 


ors 
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P.E.,., = 0.6745 o, 


This, however, does not serve the purpose It helps little, 


it all, to obtain an estimate of the score in a second form 
test, when it is a simple matter to obtain a much bette 
score by actually giving the second test. An estimate of 
score is what is needed. The probable error of estimate does 
a real value*® as a measure of alienation from perfect predi 

The third proposal (by Monroe, apparently) of a prol 
error of a test score is a development of the same formul 
has been shown that the correlation of obtained scores with t 
scores of the same function 1s 


— 
\ 


hence the probable error of estimate of true scores from obtair 
scores is 
by substitution in the formula for the probable error of esti 
This, however, is not the needed formula, but the revers 
example, the probable error of estimate of a true score fr 
obtained score. Such a formula is number 6 in the list, nat 
PES. 


The fourth proposal, namely, the ratio of P.E., to M, ir 


, = 0.6745 % — 
opinion of the writer, has no utility. Further comment is o1 
ted here, because it has received an able criticism’® since the { 
draft of this paper was written. 

The fifth formula 


is useful in evaluating certain correlation situations but wou 


seem to have no particular reference to the problem of 


reliability of test scores. 


The last formula is probably the only one of the list whic! 
is entirely adequate to the problem at hand. It possesses t 


* Especially in the form recommended by Kelley, i.e., V1 — 


Franzen, F. R. ‘‘ Statistical Issues,’’ Journal of Educational Psych 
15:367-82, September, 1924. 


Vr, 
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of being independent of the range of talent and of allow- 


regression effects in test scores. The formula, 


us the probable error of estimating re scores from ob- 


1 or fallible scores, when the true scores are estimated by 


rmula,"! 
M, 
may be re garded as the best estimate possible of a true 
such as would be obtained by the average of an infinite 
- of obtained (X,) scores It is the estimated true score 
bable error that are needed and not the reverse as in 
Kelley suggests further 


se of the third proposal above. 


se of the 
PE. 


i 


as a measure of the improvement due to the use of the test 


In conclusion, it will readily be seen that the real need in 


rtine 
ruin? 


t 


reliability data on test scores is the publication of a 


num of four things: 

The reliability coefficient 

The standard deviations of the two distributions 

The population involved in the calculation of the r’s 

The means of the two distributions 
‘hese four data will permit the treatment of reliability by 
of the methods proposed to date, and in addition, estimates 
rue scores, and prophecies of changes in reliability with 
ces in the range of talent. The estimate of regression effects 
plied as another possible procedure ; and, 
lations of test scores, the application of correction formulas 


in cases of inter- 


attenuation is made possible in evaluating true relationships 


‘Kelley, T. L. Op. cit., p. 214, formula 168. 


Actually, appears in Kelley’s recommendation, but either ratio 


to similar interpretations (Loc cit., p. 215). The ¢, cancels im numerator 
lenominator, leaving the expression und 


important measure. 
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of the variables within the validity of the assumptions of suc) 
correction formulas. 

Non-publication of such data as we have recommend 
really a violation of the ethical codes of scientific prox 
and not to be condoned by virtue of the fact that users of 
generally will not understand the technicalities. Rather, 
teacher of tests and measurements should attempt to ed 
outgoing students to demand such confidenglien the part 
test authors. The alternative will certainly me the ref 
to recommend to school officials tests and  * which 1 
critical facts are at hand. Such tests are not necessarily 
dependable, but the careful worker will not wish to assur 
sponsibilities of proof which in all fairness rest upon the au 
of the test. The test buyer is surely entitled to the same pr 
tection as the buyer of food products, namely, the true tng 
ents printed on the outside of each package. 

This statement, alone, is offered as a sufficient justificati 


for presenting facts that are in no sense original with the writ 


re 
§ 
se 
iter 


“TIONING JUNIOR HIGH-SCH¢ PUPILS BY 
TESTS AND SCHOOL MARKS! 


FowLer D. BrRooKsS 
Johns Hopkins University 


Tue PROBLEM 


‘his investigation was undertaken with the PUT 
nining the value of fifth- and sixth-grade school marks and 


in group tests of intelligence and achtevement for dividing 


ering junior high-schoc 1 classes into sections homogeneous in 
Fepect to scholarship; the accuracy of sectioning which may be 
Bécured from a few measures; and the procedures which may 
d in school administration to secure fhe most accurate sec- 

ing from the few measures employeds 
\dministratively it 1s impossible and @ucationally it is prob- 
undesirable to give a great many tests for purposes of sec 
Practical school administration necessitates such a rela- 
simple testing program that it may be an integral part of 
Iministrative policy of the school system. The majority of 
high schools are not large enough to use many bases of 


‘fication in dividing first-year classes,” especially since the 


strative difficulties of the junior high-s hool principal are 
nlicated by semiannual promotions, by the two or more 
ses open to pupils sometime after the beginning of the first ¥ 


as well as by the frequent necessity of preserving a nearly 

| proportion of boys and girls in each section on account of 

strial work—shop, cooking, sewing, sheet metal—to say 

ling of the task of maintaining a fairly constant teacher- 
T itio. 

\ccordingly we have investigated the accuracy of sectioning 
h results from using a few measures, say two oF three, of 


h one or two are available in the record system in the prin- 


before the Educational Research Association, Cineinna 
iry 24, 1925. 
If a class is divided into three sections—the top third, the middle third, 


| is the resulting 


ti, Ohio, 


er of sections. 
359 


{ 
‘> 
te 3 
‘ 
' 
bens 
numt 


360 JOURNAL OF EDUCATIONAL RESEARCH Fol 


cipal’s office. Since the theoretically best combination of 


| school marks is too long and involved for wide use, | 


ind 


suggested relatively simple ways of combining a few m¢ 


of high accuracy in sectioning. 


CONCLUSIONS 


| have set up a composite criterion of first-year junior 


school scholarship against which tests and school marks 
been checked as bases of sectioning. The following conclusi 
seem warranted. The evidence supporting them ts present 
the next section. 

1. Relatively accurate sectioning is secured if the pupils 
tering the first-vear class in junior high school are divided 
the basis of their sixth-grade school marks. 

2. Sixth-grade marks give slightly more accurate secti 
than the average of fifth-and sixth-grade marks. 

3. Dividing the first-year class of a certain junior 
chool into three sections on the basis of sixth-grade marks, 
the same time putting approximately one-third of the 
and one-third of the girls in each secticn, and making tw 


adjustments on account of differences in chronological age, ¢ 
63 percent correct sectioning. By correct sectioning 1s m« 
that the pupil would be assigned to the same section by tests 
ee school marks at the beginning of the first year in junior hig 
school as he would be at the end of the year upon the basis « 
scholastic success during that year. 
!. Intelligence quotients from a group intelligence test 
on the average, 55 percent correct sectioning, if a few read 


ments are made on account of differences in chronological ag 


* After dividing pupils into three sections on the basis of group 
gence quotients the pupils of Section I were compared with those of S 
If any pupils of Section II were more than six months older chron 
and had intelligence quotients not more than 2 points less than thos¢ 
pupils in Section I, such pupils were interchanged. And similarly f 
tions II and III. This was done because of two or more pupils having 
same intelligence quotients the older ones chronologically are, of cours 
abler. 
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of the achievement tests gives, on the average 47 percent 
ct sectioning. 
Using sixth-grade marks and the mental ages or scores 
ntelligence quotients, from a group intelligence test such as 
gerty Delta 2, and making three readjustments on ac- 
nt of f differences in chronological age, we get 73 percent cor- 
t t sectioning. 
6. In sectioning on sixth-grade marks we find that two per- 
of the pupils really belonging in the highest section are 
- in the lowest, while using sixth-grade marks and a group 
sence test reduces this sort of misplacement to one percent. 
peepee grouping, placing in Section I a pupil who be- 
es in Section II may not be a very serious error; he may 
ly be near the dividing line ; but placing a pupil in Section Ill 
n he belongs in Section I is a serious error. As we have just 
when we use sixth-grade marks and a group intelligence 
_our data show this serious error in one percent of the cases 
> Such serious errors of placement would have occurred, 
the average, in 5 percent of our cases, if a group intelligence 
ad been used by itself, and in 12 percent of the cases if one 
the five achievement tests had been used.‘ 
8 If chronological age alone had been used—the youngest 
pils being assigned to Section I, the next youngest to Sec- 
: Il, and the oldest to Section III—51 percent would have 
en correctly assigned; and 7 percent would have been seriously 
is-assigned.” 
9. Sixth-grade marks correlate 0 70 with the composite schol- 


ship criterion for 93 pupils who had been in junior high school 


rone year. Intelligence quotients from group intelligence tests 
slate from 0.50 to 0.72 with this criterion, the mean being 
with the 


Achievement tests correlate from 0.38 to 0.62 
holarship criterion, the mean being 0 50. 
10. Chronological age has a correlation of —0.49 with scho- 
lastic success in first year of junior high schoc il. 
11. The multiple correlations between two or more measures 


‘Our battery of achievement tests is not the best; it was selected for 
various purposes of which only one was predicting junior high- school success. 
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and our criterion of scholarship show the value of these meas 
in predicting scholastic success in junior high school. The 


tiple correlations between scholarship in first-year junior 


school and the combination of sixth-grade marks and int 


ents from one group intelligence test range ft 
; that is, using a group intellig 
correlation with 
from two to thirteen points; on 
points (from .696 to 791) 
about 6 points, the multiple c 


nging from 0.72 to 0.79, and averaging 0.755 
12. Chronological age adds two-thirds as much to the 
dictive value of sixth-grade marks as does a group intellige: 
test and, on the average, slightly more than does one of the 
achievement tests used. The multiple correlation of sixth-g 
marks and chronological age with the criterion 1s 0.76 
13. By adding a second group intelligence test or an achi 
ment test such as the Holley Sentence Vocabulary Test t 
combination of sixth-grade marks and a group intelligence t 
get a multy correlation of 0.84 or O.85 with first 
scholarship 
14. It is better to use sixth-grade marks and one group int 
ligence test, than to use two group intelligence tests. In the 
er case we get multiple correlations ranging from 0.72 t 
ring 0.79, whereas in the latter case they range from | 
78, averaging 0.757. Sixth-grade marks and chronologic 
r one of the achievement tests, have as high predictive 


as the intelligence quotients from two group intelligence 


THE EVIDENCE 
Let us now examine the evidence upon which we have bas 
the foregoing tentative conclusions. 
Nine group intelligence tests and five achievement tests w« 
given to an entering class in one of the Baltimore junior | 
schools. The group intelligence tests in the order in which 


*The Robert Fulton School. I am indebted to Dr. Rozell Berr 
principal, for his cooperation in this and other investigations. 
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civen are: Miller, Form A; Otis Self-Administering ; 
‘«< Form A; Terman Group Test, Form A; Haggerty, 
2. National Intelligence Test, Al; Dearborn, Revised C 
and Pintner Non-Language. The achievement tests, 
order of giving, are: Thorndike \cCall Reading, Form 3; 
Hey-Trabue Language Completion Alpha; Holley Sentence 
wilary; a group vocabulary test consisting of the first list 
ords from the Stanford Binet Test, two parts, 7 minutes 
ach part; and Woody-McCall Mixed Fundamentals in 
thmetic, Form A. 


The elementary-school marks for the fifth and sixth grad 


CS 


the chronological ages were taken from the pupil’s perma- 
at record card. The marks are upon a five-fold basis, FE, G, 
P. and D—a mark for each half-year. They were given the 
wing numerical values: E. 5: G, 4; M, 3; P, 2; and 
1. Only the ninety-three who had complete records are here 
nsidered. 
We need some standard or criterion of scholastic success in 


first year of junior high school so that we may judge the 
le of tests and marks as bases of sectioning or prediction 


problem of a criterion ts just as difficult as it is important 


difficulty with our criterion 1s that we do not know defi- 


ely or quantitatively the effect of clear-cut homogeneous 
rouping upon it. If a class is divided into homogeneous groups 
| school marks are then used, we must know about the stand 
ic which teachers have used in marking different sections. If 
pupils in each section are marked according to some scheme 
sed upon a priori assumptions of a predestined distribution of 
hievement, the distribution being taken the same for each se 
then first-year marks will be of no value as a criterion 
he correlation between marks and any truly differentiating test 
f necessity be low or near zero. If, however, some rea- 
ble standard is used, the criterion will be of valu 
lf we take as our sole criterion the results of achievement 
‘ts. we assume that the sampling in the tests really is so typt- 
| of the curriculum that we are safe in regarding relative 
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ary 
\ 
rag 
thy 
(hy 


364 JOURNAL OF EDUCATIONAL RESEARCH Vol 
achievement in the tests as proportional to achievement 


+ 


whole curriculum. Many persons are not yet ready t 
this assumption, especially in history, geography, and 


rtions of English and mathematics in the first year 


If pupils are not grouped homogeneously, are the results 1 

same as if they had been? This raises the fundamental qu 

f the effect of homogeneous grouping upon achievement 
question which we cannot discuss at this time. Under cert 
circumstances achievement has been found to be more 
closely proportional to ability. 

In view of these difficulties I have selected as the best 
able criterion of scholastic success—and probably as good a 
as I could hope to secure—the following: (1) The aver 
seventh-grade marks in English, mathematics, history, 
geography given to pupils in fairly homogeneous groups 
teachers using the same standards in marking different secti 
(2) the educational ages from probably the best battery 
ement tests now available, the Stanford Achievement T 
| have weighted the average marks 2 and the educational ag 
These weights are purely arbitrary and were selected la: 
because there are important features of the first-year cours 
study in these four subjects, which are not included in the St 
ford Achievement Tests. 

The ninety-three pupils for whom I have complete rec 
were in two sections during the first half-year in junior hi 
school. They were scattered throughout four sections duri 
the second half-year, grouped upon the basis of previous scl 
marks and chronological age, in so far as administrative 
gencies permitted. 

For the purpose of this study I have divided these pupils int 
three sections upon the basis of the criterion of scholars! 
the seventh grade, and have used this as correct sectioning 
next divided the pupils into three sections upon each of the 
teen group tests, sixth-grade marks, and the average of filt! 
and sixth-grade marks. The comparison of the sectioning up 


cl 
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f these bases with that according to the criterion to find 


and disagreement appears in Table I 


unt of agreement 
by sixth-grade 


} 


The hig! e of accuracy of secti ning 


ls is noteworthy; it is higher than that from any of the 
r achievement tests which I used. It 
the Stanford-Binet Test. This is in- 
lered in connection with 


1 cle ore 
intelligence tests ¢ 
; high as that from 
surprising, especially when consi 


AGREEMENT OF SECTIONING BY TESTS AND 


LE I PERCENT OF 
10L- 


KS WITH SECTIONING BY CRITERION OF SCI 
JUNIOR HIGH SCHOOL 


HOOL MAR 
ARSHIP IN FIRST YEAR OF 
THREE-FOLD GROUPING 


Basis of Sectioning 


n Group Inte lligence Tests 


rl like-MeCall 5 
lv-McCall 7 
y Voeabulary 45.2 43.0 11.8 
evy-Trabue 39.8 15.1 15.1 
Group Vocabulary 47.3 40.9 11.8 
17.1 40.9 12.0 


in Achievement Tests 


<tanford-Binet (1Q) 64.5 : 
Chronological Age 51.6 10.9 4.0 
Sixth-Grade Marks 63.4 34.4 2.2 
{ bination of Sixth-Grade Marks 

ind Haggerty (1Q 73.1 25.8 1.1 


interpretations often placed upon studies of the accuracy and 


liability of teachers’ marks. It indicates that accuracy of ferm 
ks should not be confused with that of the marks assigned to 
f papers in English, mathematics, or history; that the for- 
accurate than the lat- 


er may be and doubtless are much more 


ter. From three to eight teachers assigned the junior high-school 
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marks. The pupils came from five elementary schools. It 

that when Baltimore sixth-grade teachers give a final tern 

on this five-fold marking scheme they estimate not only | 

ievement, but also other qualities, abilities, or traits 

re predictive of work in the seventh grade. Sixth-grade 

were more closely related to the seventh-grade criterion of 
rship than to the seventh-grade marks alone. 

\nother way to determine the predictive value of thes: 
ind school marks is to find the correlation between them 
the criterion of seventh-grade scholarship. Then multipk 
relations can be calculated to show the predictive valu 
ferent combinations of marks and tests. I have made th 
culations. Sixth-grade marks and a group intelligence test 
relate on the average .79 with scholarship in seventh gt 

und that Haggerty Delta 2, National Al, Dearborn ( 
Dearborn LD added most to the predictive value f sixth 
marks, the multiple correlations being from .81 to .83 \ 
ond test such as National Al, Dearborn D, or Hollev S 
Vocabulary added to the combination of sixth erade marks 
Haggerty, raises the multiple correlation two or thr 


that is, to 84 or .85. Chronological age and sixth-grade 1 
give a multiple correlation of .76 with the seventh-grade crit 

Wherever I have combined scores from different tests | 
followed the standard procedure of expressing an individ 
score as a standard measure, that is, as a deviation fro 
mean of his group divided by the appropriate standard devi 
Standard measures have been weighted according to the p1 
partial regression coefficients. 

On the whole, other studies corroborate the data present 
in this paper. Upper-grade elementary-school marks have be 
found to correlate from .34 to .73 with high-school scholars! 
and group intelligence quotients from .28 to .69. School n 
have generally been found to yield slightly higher coeffici 
In one study in which a combination of eleven educational 
psychological tests gave a higher prediction of scholarshy 


the first year of junior high school than the sum of all n 
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1 in the first six grades, we must remen ber that fifth- o1 


~ 


srade marks probably have much higher predictive value 


those assigned four or five years before entrance to junior 


schor 


CoMBINING ScHooL MARKS AND Test RESULTS 


FOR SE rIONING 


Of course, the standard procedure in ¢ mbining sixth-grad 
-< and test results is to take the average or mean of each set 
easures, find the standard deviation f each set, take each 

‘dual’s deviation in each measure [rom the mean of his 

and divide this deviation by the standard deviation 


standard measures can now be combined by any desired 


of weighting, or two multipliers may be chosen such 
t they will make the standard deviations equal. For example, 
he standard deviation of the first set of scores is 4.5 and of 
second set 3.0, the multipliers would be 2 and 3—the indi 
1 deviations in the first set of measures W wuld be multiplied 
and those in the second set by 3, and then weighted and 
bined. Weighting is difficult. Our own data indicate that, 
the average, sixth-grade marks and intelligence quotients from 
roup intelligence test should each be weighted 1, but our re- 
ts are only tentative. 
One of the following ways of combining marks and test . 


sults, while statistically less orthodox, is much simpler and 


as accurate 


h nks by 


Rank the pupils in each measure and then combine the ra 


Assign decile ranks to pupils in each test or in school marks; 

_ give a rank of ten to the ro percent oO! pupils having the h ghest 
-ks or scores or intelligence quotients, a rank of nine to the next 


oercent, etc. Do this for each test used and for school marks. Each 
's decile ranks can then be combined readily If school marks and 

results are given equal weight, ranks or decile ranks can be ad led 

tly; if unequal weight, each pupil’s rank in marks can be multi 

ks in a test, and the 


by the proper weight, and similarity for ranks 
ghted ranks then added. 


; . 

tl 

‘ 

| 
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Chronological age can be utilized by placing the older 
of a given standing on combined marks and test scores 
slower section, and the younger pupils of this same standir 
a brighter section. If intelligence quotients are used inst 
scores or mental ages, the older pupils of a given intelliger 
quotient should be placed in a brighter or more advanced 
tion than are the younger pupils of this same intelligence qu 

In conclusion: The “fly in the ointment” is that we d 
know well enough the predictive value of tests and mark 

irving situations. We have data on 93 pupils in a junior 


school, on 108 pupils in the same school, and on still anoth« 


of 303 pupils We also have some evidence from a class « 


pupils in another school showing the high predictive value 
sixth-grade marks and group intelligence tests. Further im 
tigation is needed. Bureaus of research or junior high 
principals and their staffs undoubtedly would find it profit 
to discover the predictive value for their own schools « 
and elementary-school marks. If several classes are studi 
probable constants of certain predictive factors, such as 
marks, group- or achtevement-test results, and chronologi 
may be determined with a reasonable degree of accuracy 
As an aftermath of the hue and cry about the unrelial 
and inaccuracy of teachers’ marks many administrators 
come to regard them as unclean, as necessary at times for 
es tain purposes but to be used as little as possible. While 


marks‘ are not as accurate or reliable as we might wish, vet t 


undoubtedly have considerable value, especially fifth- and si 


grade marks, in prophesying scholastic success in the first y« 


the junior high school. Even the maker of intelligence tests 

ally falls back upon teachers’ estimates to help validate his t 
Combining the results of a group intelligence test with six 

grade marks, and taking into consideration chronological ag 


*Correlation between sixth-grade marks and seventh-B marks 
(n = 108); correlation between sixth-grade marks and seventh-B marks iO4 
(n 303). 

"We are not discussing marks given by teachers to a set of papers 
unreliability of such marks has been wrongly confused with that of tern 


which are based on daily grades, quizzes, examinations, attitude, effort 
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fairly accurate basis for sectioning entering junior 
ol pupils, a basis more accurate than any 


ne me of the three 
Undoubtedly other factors 


i 


but they have not been adequately analyzed or esti 


nts of which it 1s comp sed 
nresent, 

| Certain volitional, emotional, or interest factors may 
tually 


be found to add much to a com site prognosis 
prog 


ire. Absolutely perfect predictive measures may never be 


| just because growth or dev elopment may of itself intro 


a certain amount of change or variation which will con 


e to elude accurate estimate. 
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NOTES ON THE CURRICULUM IN COLONIAI 
AMERICA 


BOOKKEEPING 
In A Contribution to the History of Commercial Ed 
FE. M. Barber takes occasion to criticize the following 


its by “a recent writer on the history of early business 


cation in America” 


— 
wuuble-entry bookkeepu ; know! 


to-day was not known in 1840. An earnest young man the: 
ing in Philadelphia wishing to learn bookkeeping applied 
many merchants, but none would teach him or accept him 
bookkeeper without experience. He went to New York 


found no one there to employ him or teach him bookkeeping, a 
each merchant had his own way of keeping accounts 


well-defined rules and was not taught save under the eye 


Bookkeeping was not then, as it is now, a system. It hadt 


business men themselves 
About 1845, the first business school in New York was start 
by Benjamin Foster, a native of England, and the instruct 


given was in penmanship and bookkeeping 


Mr. Barber proceeds, in rather direct fashion, to exposé 


writer of these irritating paragraphs: 


The last date quoted, it will be observed, is 1845. Now, thes« 
statements come into collision with the truth at so many point 
as to remind one of the famous Academician who defined a cra! 
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“a small red fish that walks backwards,” a definition which 


ved to be true excepting in thre particulars: it was not red; 
s not a fish; and it did not walk backwards 
rompted by curiosity, som¢ weeks ago, I determined to as- 


City of New York, foremost in com- 
have been ignorant of double-entry 
ial teachers and schools, 


or commerck 


er some research, Mr. Barber finds, in the New York City 


for 1818 the nam 
“Public Lectures on Bi okkeeping,” either 
fennett in New 


; f lames Bennett, Account 
vho began his 
+ year or in 1824.2 But there was another | 


t this time, one James Gordon Bennett, who advertised, in 


‘an English classical and Mathematical school for the in- 
en, intended for mercantile pursuits.” 


n of young gentlem 
chool, “if ever actually formed, had a brief existence.” In 


James Gordon Bennett “returned to newspaper work.” 


If New York’s claim to priority wert otherwise jeopardize d, 
uld contend that this was the first commercial school 
ded in America. Curiously, that honor belongs, I believe, 
nother man by the same name.” James Gordon Bennett 
have doubted his ability to withst ind the James Benne 
etition, and, probably, this had something to do with the 
his proposed permanent comme rcial school.” 


\ Herrick, who had examined Mr. Barber's “cart ful 


Savs. 
The probable facts are that the spirit of the technical busi 
traced back to R. M. Bart J 


oS school of this country can be 


and that there has been a continuous development of this 
nstitution from his crude beginnings It seems probable that 
Bartlett began his first school for the t ching of pet nship 
kkeeping, and comme rcial arithmetic at Philade Iphia in 1834 


| k. C. A Ve and Practu Co 
Macmillan Company, 1904. p. 179. 
To whom belongs the honor of the first vet 


% 
a4 
he 
rtain, if possible, why t ' 
nd fir ince sh 
Ll eping and deprived 
r to the year 1845." Be 
25 
4 
y 
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MI Contribution to the History of Commer al Educa 
| ng he astern Com 
An address deliver at the Annua Meeti g th 
| Tonchers Association, held at Brooklyn, New York, April, r 
Ihid., p. 7. 
t heer 3 
By there the honor elaime Sas Renne 
lia of Educatwr Paul Monroe, editor. New York, Maemillan I “2 
1911. Vol. II, p. 144. 
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Both Barber and Herrick have overlooked certain imy 
sources of information on this topic. The colonial news; 
record the existence of schools in which commercial trai 
was given for a full century before the ventures of Bennett 
Bartlett 

Strange as it may seem, bookkeeping was taught in 


as early as 1709: 


Reading, Writing, Arithmetick, Merchants Accompts, Ge 
etry, Trigonometry, Plain and Sphaerical, Dyalling, Gaugi: 


> 17 


Astronomy, and Navigation are Taught And Bonds, Bills, 
dentures, Charter-parties, &c. are drawn; and Youth Boards 
in Cross-street, Boston. By John Green.* 


- There it is: “‘merchants’ accompts.” In 1718, “Mr. Br 
Tymms Living at Mr. Edward Oakes Shopkeeper in New! 
Street at the South End of Boston” taught “Young Men Arit! 
metick and Merchants Accounts.”* 

Although similar New York records are not available 
these years, it may be assumed that bookkeeping was taught th 


as early as in Boston. Both cities were important comme: 
centers before the close of the seventeenth century, and tl 
must have been some response to the demand for business ti 
ing. George Brownell, of New York City, in 1731, offe: 
“merchants’ accounts;”* and in 1734, Alexander Malcoln 
nounced instruction in “merchant’s book-keeping.’’® 

Bree In Philadelphia, 1733, Andrew Lamb advertised that he « 
tinued “to teach Merchants Accompts, after the Italian Man 


* Boston News Letters, March 21-28, 1709. 

Boston Gazette, August 31-September 7, 1724. Samuel Grainger: 
ing, Accompts and the Mathematicks.’’ Also September 4-11, 11-18, 
Samuel Grainger: ‘‘ Writing, Arithmetick, Book-keeping.’’ 

’ Boston News Letter, February 24-March 3, 1718. Also March 5-12, 1 
19, 1730. Charles Lewis: ‘‘ Writing, Arithmetick, Merchants Accompts, F 
eign Exchanges, either in French or in Fnglish.’’ 

* New York Gazette, August 31-September 7, 1731. 

New York Weekly Journal, March 24, 31, and April 7, 1740. James 
Foddey: ‘* Accompts.’’ 

*New York Gazette, December 30-January 7-14, and 14-21, 1734. 

New York Weekly Journal, April 6, 13, 27, and later issues in 1741. Jo! 
Campbell: ‘‘Merchants Accompts.’’ 
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uble Entry, Dr. and Cr. by the best Method.”"® The sub- 
s taught in Charleston, South Carolina, 1744, by Stephen 
George Brownell, and John Pratt ;2 and in Chester 
Maryland, 1745, by Charles Peale.* The Italian 
d, or double-entry bookkeeping, appears in many schools 1n 
hteenth-century America."* 


The usual commercial course of the period included “‘mer- 


tile arithmetic,” bookkeeping, and penmanship For those 
were preparing to enter the employ of merchants engaged 


reign trade, the schools offered instruction in French, Ital- 


inish, and foreign exchange 


J 
rortuguese, 


SHORTHAND 
Professor Andrews, in a chapter on “The Intellectual Life” 
the American colonies, says: 
Whether shorthand was anywhere taught is doubtful and 
ly improbable, yet from Henry Wolcott, Jr., of Windsor and 
r Williams of Rhode Island to Jonathan Boucher of Vir 
ia and Maryland there were thos who were familiar with 
t. and occasional ré ferences to writings 1n “characters” would 


nt in the same direction. 


quent references to shorthand by men like those just men- 
d are evidence of its use by ministers and writers of the 
riod. Many others learned the “art of character-writing’ 


r the purpose of taking down and preserving sermons. * 


i 


le 


September 6-15, 13-20, December 14-21, 1733, 


ry, 
4 and 1735 appeared the notice of Theophilus 


4{mertican Weekly Mer 


cu 
n many issues during 17 


‘<Merchants Ac nts 
Pennsylvania Gazette, August 18-25, 1737. William Robins: 300k- 


ith Caroli a Gazette, June and 2U, 1744 
South Carolina Gazette, September 3, 10, and 17, 1744. George frownell 


hn Pratt: ‘‘Merechants Accompts, in the true Italian Method of Doubk 


F by Debtor and Creditor.’ 

: Pennsylvania Gazette, March 12, 19, 26, and April 2, 1745 

Sevbolt, R. F. Source Studies 
James Hliinois. University of Minois, 1925. Chap. IT 
( 
\ ( M Cale | i ‘ Yale U1 Press. 
142-43. Italics mit 

Keo called the ‘‘Art of Characterie,’’ ‘(the Art of Swift Writing,’ 


hygraphy,’’ ‘«Cryptography,’’ Palygraphy,’’ ‘¢Tachygraphy, 
Thoographia,’’ during the seventeenth and eighteenth centuries. 


} 

125 

+ 

nit 

Bit 

4 
n 
= 
f 
el 
{ 

an 

as 

‘ 

a 


JOURNAL OF 


\nother writer states that 
from about the middle of the nineteenth century; but it 
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“shorthand writing was t 


s+ 


taught as a science or for professional rather than comme: 


> 7718 
purposes. 


)f shorthand in this country. 


It is impossible to establish the earliest date for the te 


Records at hand indicate t! 


was Offered in Boston as early as 1728: 
Caleb Philipps Teacher of the New Method of Short Han 


1S remov'd to the north door ( 


As this way of Joyning 3, 4, 5, &c. word 


yf the 


Town House in King-street 
ls in one 1n every Ser 


tence by the Moods, Tenses, Persons, and Verb do’s not in t! 


least spoil th 


e Long Hand, so it is not anything like the Mart 


for Sentences in the Printed Character Books being all wrot 
according to the Letter, and a few Plain and Easy Rules. 

N. B. Any Persons in the Country desirous to Learn thi 
Art, may by having the several Lessons sent Weekly to them, | 


perfectly 


The next announcement of 


lished by a group of prominent citizens of Bostor 


that occasion “to recommend 


Wuereas Mr. Caleb Philipps arriv’d here last Fall fr 
England, a Master of the celebrated Mr. Weston’s Short-Hand; 
which has the fame of being the quickest, most regular, ar 
and having seen to our Satisfaction 
as also something of his Aptness t 


easiest learnt of any; 


Dexterity in writing it, 


teach it by the Improvement which one in particular has alr 


Ameriea.’’ (p. 214) 
* Boston Gacette, March 18-25 
* Boston Gazette, April 1-8, 
Caleb Philipps’ sponsors were 
in 1728 
tenjamin Colman (Harvard. 
low of Harvard College; died 1747 
In 1724, he was elected President 


foseph Sewall (Harvard, 1707; 
f Harvard College; died 1769) was elected 


but declined 


mas Prine Harvard, 1707; 


Old South Church. 
William Cooper (Harvard, 17 


instructed as those that live in Boston 


Cale 


b Philipps’ school was pub 


who 


his Art”: 


the n 


1692 ; 
was 


of H 


12; 


arvard, but 4 


A. 


ror 


1, 


» 1728. 


10st prominent clergymen of B 


A.M.; 8S.T.D., Glasgow, 1731 
pastor of the Brattle Street 
leelined 


M.: S.T.D.. Glasgow, 1731: Fel 
President of Harvard l 

M 1 1758 ~ 


A.M.: died 1743) was elected 


dent of Harvard in 1737. but declined ‘‘this honor and trust. 


Thomas Foxeroft (Harvard, 
mittees of the Harvard Board 
Joshua Gee (Harvard, 1717; 


1714; 


A.M.; 


\.M.; died 1769) served 


of Overseers 


Librarian of Harvard College: 


1748) succeeded Cotton Mather as pastor of the North Church. 


as 
y 
Herrick, op. p. 108. ‘*Biy 1840 shorthand hed become per 
aie 


‘1 
es 
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de under him; and being, by what we are inform’d, of a 
eless and laudable Conversation— We Judge it may be for 
publick Good to recommend his Art to all that are like to 
e Occasion for writing much; esp cially to Scholars, a 


that would preserve the Sermons they hear in public for 


nd 


‘r further and lasting Use 

By the Prints from London it appears that this Method has 

recommended itself, that Mr. Weston has obtained His 
ty’s Royal Authority for the sole printing and publishing 

for the space of fourteen Years; and we are also 


dibly inform’d that many of the Nobility, Gentry, Ministry, 


Ste have taken the Pains to learn it; and we are persuaded it 


wuld be of great Advantage, if it should be commonly receiv'd 


this improving Country. 


BENJAMIN COLMAN 
JosepH SEWALL 
THOMAS PRINCE 
WILLIAM COOPER 
THOMAS FOXCROFT 
GEI 


Philipps was quite up-to-date in his method of instruction 
pleted, was published in 1727, 


on’s text, Stenography Com 
in which Philipps appeared in Boston 
Stenography Completed, or the art of Shorthand brought to 
being the most easy, exact, lineal, speedy, and 
sible method extant; whereby can be joined in every sen 
nce at least two, three, four, five, six, seven, or more words 
rether in one, without taking off the pen, in the twinkling of 
and that by the signs of the English moods, tenses, per 


eve > 
etc. never before invented. By this new 


ns, participles, 


nethod any who can but tole rably write their name in round 


(by this book alone, without any t icher ) 


nd may, with ease, 
h, trial 


ke down from the speaker’s mouth any sermon, speec 
lay, etc. word by word; though they know nothing of Latin; 
nd may likewise read another's writing distinctly, be it ever so 
ng after it is written. To perform this by any other shorthand 

ym the books them- 


xtant is utterly impossible, as 1s evident fre 
elves. The nature, use, and excellency hereof, are more fully 
ontained in the preface. Composed by James Weston, the only 


author and professor of this new method. London. Printed for 


he author, and sold by him at the “Hand and Pen,” over against 
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Norfolk street, in the Strand; where he continues to teach this 


new me th <peditiously 


At least thirty different systems of shorthand had been publis! 


in England by 1727. 

The art was not unknown in Philadelphia in 1729. § 
Keimer, printer and book-seller, finding himself in financial 
culties, offered to give away shorthand texts as premiu 
order to increase his sales: 

The said Keimer (Samuel Keimer, printer of the Penns 
vania Gazette) has re-printed a fresh Impression of Short- 
Hand Books, to give to every one that shall lay out but Thre« 
Shillings in Bonds, Bills, Indentures, Primmers, Accidences, or 
other useful Books, he selling cheaper than ordinary in order t 
the more speedy enabling him to do Justice to his Creditors.” 


Following the transfer of his business to David Harry, Kei: 


published many notices requesting his debtors to pay up. 


In New York City, 1751, “a new invented Short-Hand”’ 


taught with reading, writing, arithmetic, book-keeping, and ot! 
subjects, in a school conducted by Benjamin Leigh and Garr 
Noel.2* A “new and concise Method of Writing Short Hand 
was offered, in New London, Connecticut, in 1777, by “A You 


Man that can be well recommended.’’** 


Clerks of courts and town meetings, and secretaries to cet 


tain officials, as well as “Scholars, and those that would preser 


the Sermons they hear,” made use of shorthand. Although 
had not come into general use in the business life of the colonies, 
there seems to have been a demand for instruction in “sw 


Writing” in the larger cities of eighteenth-century America 
Pitm: n, Isanc { Jiistor of Shorthand editir n. L 
Isaac Pittman & Sons, 1891, 19-20. 


™ Pennsylvania Gazette, Eighteenth of the Seventh Month, 1729. 


* New York Gazette Revived in the Weekly Post Boy, January 21, 
1751. Also, February 25 and March 4, 1751. An unnamed master ‘‘teac! 


a new-invented Short Hand.’ 


* Connecticut Gazette and Universal Intelligencer, August 29, Septet 


12, 1777. 
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THE CURRICULUM IN COLONIA! [ERICA 


Sc HOOL-E.QUIPMENT 


ls did not come 


According to Wickersham, “slates and penci 
use until after the Revolutionary War.”** 
is repeated by Cajori.™ Clifton Johnson says: 
t come into general use until about 1820, and lead pencils 


This observa- 


“Slates 


for a good many years after that.”27 This may have been 
source on which Cubberley relied for his statement that 
tes were not introduced until about 1820, and pencils and 


| pens did not come into use until much later.’ 
slates and pencils 


198 
- 


Such statements make one w' nder why 
advertised by various bos ksellers of the eighteenth century. 
no one purchase or use thet 1? Joshua Blanchard, of Bos- 
old “Slates,” and “black lead Pencils.” in 1743.29 The ad- 

tisements refer to “Pencils,” “Pencils with or without Steel 

“Best black lead pencils with silver cas “Middleton's 


ry best Lead Pencils.’”*° 


One author informs us that “The colonial schools had no 
kboards and no maps, but once in a while a schoolhouse in 
more flourishing communities would possess a elobe ;"*' an 
that “During the first half of the century after the War 


‘ the Revolution . . . . Charts, maps, and globes had not come 


Wickersham, J. P. A History ¢ f Education in P sylvanta. Lancaster, 
nsvlvania, Inquirer I blishing Company, 1886. p. 192 

*Cajori, F. The Teaching and History »f Mathematics in the United 

hingtor C., Suy D S00 U. S. Bureau 


York. Macmillan Company, V, 341 ‘<Slates were rather slowly intro 
1 into our schools and rarely found } } ff 


*Cubberley, E. P. 
ghton Mifflin Company, 1919 p. 36. 


Readi qs the History f Educatewn New k, He ighton 
Mifflin Company, 1920. p. 369 q ea Noah V ater Before the Revolu 
let schools.’ 


and for eome wears after, no Sia Ss we 


exece pt ng 
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‘ 

1es, . 
in the United States. New York, 

* 

Boston News Letter, December 29, 1i45 “3 

\ York Gazette or Weekly Post Boy, 3 vy 12, February 16, 1764 7 

m Cockburn sold slates 

New York Mercury, April 9, 1759; June 23, 1760; September 1, 1777; ‘ 

her 20, 1779: October 30, 178! 

lohnson, op cut 7 

Cajori, op. cit., | 10: ‘*Sehor 

ng the ferule and birch rods 
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into general use.’“* Although blackboards are not menti 
in the sources examined, it is probable that they were in 
here and there. Christopher Dock’s blackboard could not |} 
been the only one in eighteenth-century America. 

The records reveal a different situation, however, with 


spect to the use of maps and globes. Theophilus Grew, of Phil 


> 


delphia, 1735, taught “the Use of Globes, Maps.’** In 1) 
I 


Charles Peale, “At Kent County School, near Chester Tow: 


Maryland,” gave instruction in “the Use of the Globes, by 
gest and most accurate Pair in America.’"* John N 
Hutchins, of New York City, 1763, announced that he 
“a good Sett” of globes, both “Celestial and Terrestrial 


Maps, and “the making of Maps” are mentioned frequent, 


the school announcements of the period.** In the seaport citi 


+ 


all the “better” schools, in which navigation and geography we: 


offered, were equipped with globes, maps, and charts, and tl 


students were taught to use them 


Swett. J ] New York, American B 
( 16-2 Also during N 
( S } will | 
) 17 > 
/ ( M ] 9, 26, April 2, 1745 
I M li 74 Nathan Prince, Bost« 
the Gl 
I f t a. 17, 24, M 1, 1749 Tohn Leach, | 
Use « G) s and ¢ 
\ } April May 2, 176 
\ } ( t Revived in the Wee Post Bo Ta 
1751 B. I and G. Noel, New \} City: the Use of t Gl 
\ } G te or Weekly Post I January 12, I iry lf 
Wo ( irn 
* Pennsylvania Gazette, September 12, 1771. Maguire and Power, | 
delphia: ‘‘*the use of globes and maps, and how to make maps.’’ 


na 
N York Gazette or Weekly Post Bo 
Leeth, New York City: ‘‘the Construction of the Plain and Mer 
Chart.’’ 
New York Mercury, Muy 6, 13, 20, September 30, October 
Thomas Carroll, New York City. 
Ne York Gazette and Weekly Mercury, October 28, November 
1771. James Conn, Elizabethtown, New Jersey: ‘‘the most useful a 
diffieult Part f Ci raphy, viz. Drawir Maps and Charts, whether 


Mercator, Spherical or Conieal; together with their Explanation, 


Reason why each Kind are drawn in the Manner they are.’ 


y, May 12, 19, 26, 1755. Ro! 


re 
wn, 
In 
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-X¥ PERIMENTAL STUDIES OF THE RESULTS 
OF COLLEGE NOTE-TAKING 


In an article in the November issue of this journal,’ the 


ter summarized certain correlations which he had found to 
between lecture notes and the subsequent quiz grades of 
re students. The data used in the study did not permit an 


lvsis of the effects of note-taking under experimental con- 


ns. In this article an attempt is made to analyze further 
different factors involved in note-taking. A series of expert- 
nts will be reported which include groups of students taught 
three different instructors and which involve three quite dif- 
rent types of classroom pr cedure, namely, the formal lecture, 
the class discussion based on library reading, and the recitation 
n the textbook. Furthermore, the conditions under which the 


tes were later reviewed varied considerably in the different 
periments. Although this study is fairly comprehensive, it by 
means exhausts the list of circumstances under which students 
le notes and use them. ‘The results reported must, there- 
re, be judged in the light of the conditions under which they 
re procured, and the reader must exercise caution in generaliz- 
ng upon these findings and in applying the conclusions here made 
situations radically different from those which prevailed dur- , 
the study. 
The problem considered is two-fold: First, judged by the 
sults of immediate recall, is it more effective to take notes as 


~ 


lecture is being delivered or to listen without taking notes? 
ond, judged by the amount of the information retained, sev- 
ral days or weeks after a lecture, is it more effective to take notes 
t the time and review them later, or to take no notes and to de- 
pend upon memory or other sources of aid in reviewing? An- 
ther problem closely allied to our study is the investigation of 


‘Crawford, C. C. ‘¢The Correlation between College Lecture Notes and 
Papers,’’ Jour? Wl of Educational Research, 12:282 91, November, 1925. 


379 


a 
University of Idaho aah 
a 
\ 
TL, 
Tt 
‘ 
it of 
= 
) 
in. 
4 


SO Jul VAL OF EDUCATIONAL RESEARCH Vol 


qualitative differences between the results of n te-taki u 


listening It is reasonable to expect that two radically al 
methods of procedure during the class perk d may produ 
different kind, as well as a different amount, of mastery 
have. therefore, used the true-false test and the traditior 
side by side in several experiments to detect, if possibl 
uch qualitative differences. Two types of exp riments wel 
one in which the results were measured immediately aft 
lecture period and the other in which the results were measu 
fter an interval sufficiently long to permit a c nsiderable 
of forgetting and to make it necessary to use some kind 
view. The first three of the seven experiments reported 
vere to measure the effect of note-taking and the last 
easure the net results of note-taking plus review 


rotation experiment arranged according to the met! 


scribed by \MecCall.* 


PROCEDURE OF EXPERIMENTS MEASURING THE IMMEDIATI 

SULTS OF NOTE-TAKING 

Experiment I.—A class. of 38 students, chiefly Sophor 
was divided into two groups, A and B During the first | 
Group A was asked to take notes while Group B listened 
twenty-minute quiz of the traditional type followed. The 
day the program was reversed, Group A listened while Gri 
took notes, and a quiz, similar to that of the preceding day, w 
given. Each student received a code number to use instead 
his name, so that each paper was graded without the mark 
knowing the group to which the writer belonged. Similar 


cautions were employed in all the experiments. 


Experiment I].—The procedure in this experiment was esse! 


tially the same as that in Experiment [, but in addition to t! 


quiz a true-false test was given each day. Representatives 


the four college classes were enrolled among the 129 students 


in this group. 


lneatio New Yor 
; E ; Educati I 
ill \ / 
* Met W 
millan Company, 1923 PI : 
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Experiment 11].—The students and teacher of Experiment I] 

used again in this section. The two pr cedures were simi- 
but in this experiment the testing was more con prehensive 
. true-false test in Experiment II contained ten questions and 
general quiz period was eight minutes, but in Experiment II] 
true-false test included fifteen questions and the quiz period 


-s lengthened to fifteen minutes 
> 


CEDURE OF EXPERIMENTS M EASURING THE REVIEW VALUE OF 


NOTES 

Experiment I1V.—This was a rot tion experiment involving 
{ students, chiefly Juniors. After each of two lectures the stu- 
nts’ notes were collected and held tor a weck. Then notes on 
lecture were returned to Group A and notes on the other to 
ip B. Five minutes were allowed for review of the notes, 
r which both groups were given a written quiz of one hour 


ering both the lectures. Thus each group was questioned on 


lecture which had been reviewed and on one which had not 
Experiment V- This phase of the study was but a continua 

f .xperin ents and and the Same students were used 
subjects. At the close of a series of four lectures, the notes, 
vhich each student had taken, were returned to him, but since 
ups had taken notes on alternate days, each group had 


on the two lectures to which the other group had but 


gre 


stened. A period of ten minutes was allowed for reviewing 
notes. This was followed by a test in two parts; Part I 


rk luded sixty true-false questions, grouped according to the 
tures on which they were based, and Part II consisted of four 
veneral questions, one on each of the four lectures. The two 

set nerimental factors compared, therefore, were | 1) taking notes 
tl d reviewing them and (2) listening to the lectures and trying 

n retain them without notes and without review. 

lents Experiment V1.—Another factor appears in this experiment, 
the class periods were devoted to discussions based on the 

on brary reading done by the students. The class consisted of 


5 Sophomores, but because of absences only twenty cases were 
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available at the close of the experiment. The class was diy 
into two groups, which took notes on alternate days. Thi 
periment covered six class days during a period of two y 
followed by two days for testing results. The first test day 
devoted to a general quiz of one hour, consisting of one cor 
hensive question on each of the six class discussions. On = 
second test day was given a true-false test consisting of ten ques . 
tions on each of the six class discussions < 

Experiment VII.—This experiment included 55 students, 7 
chiefly Seniors, and was very much like Experiment VI. 1 


principal ways in which it differed from the former were 
the class periods were devoted to recitations on the textb 
and not to class discussions of library readings; (2) no tru - 
false test was given; (3) there were eight days in the series ir 
stead of six; and (4) one day was devoted to a review direct: 
by the instructor before the final quiz was given 


RESULTS 


Limitations of space forbid the inclusion of the detailed si 


rs 


of the subjects tested, but the means and standard deviatior 
the different sets of scores are given together with the net 
ferences between the results with and without notes. Th: 


EXPERIMEN 


liability of each net difference is shown by its “experimenta 
coefficient.’” 

wee | The results of note-taking and of the use of notes as meas- 
ured by the general quiz of the traditional type are given in 


LILTS OF 


Table I. In each of the seven experiments there is an advantag« 


in favor of notes. This advantage, small in Experiments I and 


VII, is large enough to be of considerable importance 


others. The results of the different experiments can best bx 


TATY 


determined by the comparison of their respective experimental 
coefficients. This method of comparison is not altogether valid 
because the number of students in the different groups varied 
Experiments II, III, and V involved over 120 subjects each, 
whereas the others involved from 20 to 55 subjects. Sine 


*MeCall, op. cvt., pp. 154-58. 
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experimental coefficient is dependent upon the number of 


jects, those experiments having only a few subjects have 
coefficients even though the numerical differences in scores : 
be greater. A careful analysis of all the facts seems to justify 
the conclusion that the immediate value of notes is less than th 
delaved-review value. This immediate value is of suffici 
rtance, however, to justify the practice of taking notes 
if there be no opportunity to use them later 
The extremely low coefficient, 0.2, for Experiment VII 
pre bably due to one, or possibly both, of two causes: (1) T' 
class periods were devoted to recitations on the textbook rather 
than to the presentation of new subject-matter. (2) The ex- 
amination period of one hour was too short to permit the stu 


dents to finish their papers, and the test may thus have f 
to measure differences which actually existed. The writer pr 
fers the former view. 

The results as measured by the true-false test afford an ex 
tremely interesting contrast to those just examined. It will b 
recalled that in four of the experiments true-false tests and the 
general quiz were given during the same period; they consti- 
tute, therefore, supplementary or additional measures by a dif 
ferent type of testing device. The essential difference between 
the two types of the tests seems to be that the true-false test 
measures ability to recognize specific points, whereas the general 
eet ' quiz measures the ability to recall a number of points and orga 
ize them into their natural sequence. Table II shows the results 
of the four experiments in which the true-false tests were given 

Curiously enough according to Table II three of the experi- 
ments vielded negative coefficients The only positiy e coefficient, 
namely, that of 0.9 obtained by Experiment V, is lower by .5 
than the coefficient obtained from the general quiz in the 
class. The fact that none of the negative coefficients is larg 
enough to be significant is worthy of note and admits of the | 
sible interpretation that the true-false tests are really not satis 
factory measures of anything and that the negative coefficients 


obtained are merely due to chance. The coefficient of 
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‘nent V contradicts this interpretation, however, and the 


that there are no slight positive coefficients also makes it 


what doubtful. 


of the contrast between the re 


writer's interpretati 


obtained from the general quiz and the true-false test 1s 


fferent quality o1 student achieve- 


the latter measures a ¢ 


It measures ability to rec nize specific points, whereas 


>a series Ol 


eneral quiz measures ability to re all and organtz 


Taking notes seems to be the more « ffective method of ac- 


¢ the latter ability, and listening without taking notes seems 


slightly more effective in acquiring the former. Indeed, 


‘; what we might expect, since the note-taker, because of 


greater attention to the important points, may be somewhat 


to overlook and entirely miss certain statements ol! 


] 
mea 


1° importance which may later be included in the true- 


~ te st. 
The fact, that the negative coefficients < 
itive coefficient high, suggests that in so far as these results 


~ 


re low and the one 


be of practical guidance to students they should encourage 


ther than discourage note-taking This is due to two tacts: 


Notes are taken for their review value as well as for their 


liate value, and. even the true-false test shows undoubted 


value in Experiment V. (2) Efficient study demands a 


h ereater ck Tee of ability to select, organize, and recall im- 


tant facts than of ability t recognize specific points when 


are stated 


AND CONCLUSIONS 


We have now examined the results of seven experiments, 


lving a number of classroom situations typical of those in 


ch students ordinarily take notes. These have included a suf- 
iently large sampling of subjects to be fairly representative of 


On the basis of these results we 


llege students in general. 
re justified in concluding: 
1. When results are measured by a general quiz of the tra- 


nal type immediately after the lecture the note-takers show 
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a fairly high degree of superiority over those who do not 
notes. 

2. When results are measured by the general quiz afte: 
period of days or weeks and after there has been opportunity 
review the notes which were previously taken, the note-taker 
show marked superiority over those who do not take notes. 

3. When results are measured by the true-false test immedi 
ately after the lecture, the note-takers are slightly inferio: 


the listeners. 
4. When results are measured by the true-false test after 
period of days or weeks, involving the opportunity to review th 


notes, the note-takers are at an advantage, but not so great 
in the case of the general quiz. 

5. The difference in results between note-taking and listet 
is not only characterized by the amount of the lecture retained 
but probably also by the quality of the organization of the ideas 
retained. 

6. The value of taking notes depends upon the nature of th 
class period and is greater when the hour is given to the presen- 
tation of new subject-matter than when devoted to recitation on 
the textbook. 

Additional investigation to supplement the results reported in 
this article might well include studies of the following problems 

1. Further analysis of the qualitative differences in the re- 
sults of note-taking and of listening. 

2. Further investigation of the true-false test as compared 
with the general quiz as a measuring instrument. 

3. Determination of the results of different methods of tak- 
ing and using notes. 

4. Determination of the results of note-taking under other 
circumstances, for example, by high-school students. 

5. Determination of the results after periods of training in 
the use of notes or in depending on memory instead of notes 

6. Determination of the value of taking notes or making 
outlines of material in books. 
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DIFFICULTY OF TI NUMBER COMBINATI¢ INS 
The appearance in the Journal of Educatt nal Psychology for 
25 of another article on the difficulty of number c ymbinations 
itson and Combellick ) leads us to raise the question, What 

can we make of the results of such studies? 
1914, and in some respects no one has 


Holloway began it in 
ne a better job than he. To be sure he confined his attention 


erely to addition and multiy 

may regret it, 1s nevertheless defensible. 
-<’ dissertations would more rigidly limit their problems! But 
Another way in which Holloway circum- 


lication—a limitation which, while 
If writers of doc- 


hat’s another story. 
scribed his work—and this time one can’t be so forgiving 
as the same facts. For ex- 


was 


in reporting direct and reverse facts 
mple, in his study, 6 > 2 is the same as 2+ 6; 7 <4, the same 
as 4X7. Holloway’s own figures must have shown him that 
ground, but it does so impressiv ely. It 
difficulty, namely, learning and reten 


received little subsequent attention 


this was not the case, but in other respects his study is admirable. 


It not only breaks new 
employs two measures of 
tion after learning, that have 
from investigators. Moreover, it definitely starts the analysis of 
textbooks when it shows the number 
ddition facts are repeated in three “number primers.” 

‘ttention to the difficulty of num- 


of times the fundamental 


Counts in 1917 gave some 
ugh this was not his main problem. His 
iministering of the Cleveland 
igs of this par- 


ber combinations alth« 
data were gathered from the a 
Survey Test. Limited as he was to the offerit 
port on the 


ticular test. he was able to give only a fragmentary re] 


ber tacts. 
Smith in 1920 introduced “time of resp‘ mse” as a measure 
of difficulty although, except in addition, he also reported the 
number of errors. His tables cover all four operations and dis- 
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tinguish—again with the exception of addition—al!! the b 
facts instead of only forty-five of them. 

Clapp in 1924 presented a complete report in which he ; 
only recognized all the basic facts in each operation but als 
ported his facts separately for each grade from the third to t 
eighth inclusive. It is worth noting that he gave percent 
error not only when the isolated combinations were presented 
but also when the same combinations were required in the mor 
advanced processes. 

Now comes the article by Batson and Combellick. It gives 
for each of the one hundred facts of addition and multiplicati 
the reaction time of adults. 

Thus we have from several points of view data on the « 
culty of the number facts. In their broad outlines these « 
tell much the same story. Clapp and Holloway on the forty 
five addition facts common to their studies correlate 0.67 in their 
determination of difficulty in spite of considerable differenc: 
method. On multiplication facts they correlate 0.84. Smith a: 
Clapp correlate 0.78 on the difficulty of addition facts, although 
the former used time reaction and the latter the percent of errors 
as measures of difficulty. The same investigators show cor- 
relations for division of 0.40, for subtraction of 0.71, and 
multiplication of 0.79. Other correlations, although they 
literally too numerous to mention, are likewise strong. 

The question persists, What is the best use we can make o! 
these facts? Thus far the suggestion most frequently offer 
is to present to the children opportunities for practice in act 
ance with the known difficulty of the number facts. Following 
this suggestion after it was first made by Holloway, not a few 1 
vestigators have scored up the occurrences of each combinati 
in arithmetic textbooks. The result has been to the general « 
fect that difficult facts appear much less frequently than eas 
facts. Accordingly, the effort is being made to provide a bette: 
balanced drill, both in textbooks and in practice material. 

More than this is possible, however. Those who argue that 
certain number facts are hard, because they have not been suff- 
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ly practiced, are evidently o1 ly partly right. The inverse 
-relation between frequency of occurrence in textbooks and 
ficulty is far from perfect. On the basis of Clapp’s data the 
cient averages about —0.42. If the relative emphasis on 

tice as afforded by textbooks is a reasonably close measure 
: the relative emphasis afforded by the school, then there would 
pear to be different degrees of difficulty inherent in the com- 

tions themselves. It appears likely that 7 +9 is harder by 
very nature than 2+ 2. If this is the case, something besides 
more frequent repetition of 7+9—16 is suggested. 

This brings us to the initial teaching act. If 7+ 9 1s hard, 
is good practice to introduce it as we do other things that are 
rd. In the first place, we may do well to postpone it until 
facts have been taught—facts which lead up to and sup- 


rt this particular fact. Do we not do this in other subjects: 


wT 
“itl 


Who teaches hard words first in spelling? Does any one teach 


livision by using two-place divisors before one-place divisors? 


in reading do we not begin with short sentences and easy words: 
\Ve feel instinctively that this is right. Then let us in respect 
to the number combinations, adopt an order of teaching which 
takes account of the probable inherent difficulty of the several 
ombinations. 

In the second place, let us teach the difficult facts with the 
creater care which their difficulty requires. If we are truly ex- 
cert teachers we shall know how to do this. We shall have more 

quent resort to concrete material in the case of a hard combi 
nation. We shall postpone longer the moment when the pupils 
re left without support to make their own response. We shall 
twell longer upon applications to meaningful situations. And we 
shall take advantage of number facts already presented. 

A word—though not more than a word—on this last point, 
7-4+8—15 is a hard fact, one which possibly a third of the 

hildren of grade m1 will get wrong. But 7 + 7 =14 1s an easy 
mbination. Apparently only about one-twelfth of the third- 
rade children get it wrong. Now, if the c ymbinations have been 
taught in an order which takes even slight account of their dif- 
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ay: ficulty, 7-++7—14 will have been presented and extensivel 


practiced before 7 + 8=15 is reached. This fact permits 
older association to be brought to the aid of the new one. W¢ 
may show that, since 8 is one more than 7, 7 +8 must be 
more than 7 + 7. 

Finally, knowledge of the relative difficulty of combinati 
will enable the teacher intelligently to supplement even the 
proved textbooks and practice materials which modern res¢ 


is likely to bring forth. There are reasons why it may ne 


be possible to give in a textbook practice on number cor 


‘ tions in strict conformity to their difficulty It may not ever 
desirable to do so. Consider, for example, the preponderar 
E 1’s involved in borrowing or in equal additions in the procs 
subtraction. ‘This is only one of many considerations which 1 
: make it inadvisable for a good textbook to parallel the diff 
ranking of number combinations. 
a Much, therefore, depends upon the teacher; and in ord - 
is do her part, she must know rathet accurately the relativ * 
z ficultv of the combinations {f she has this knowledge tl 
x are many possibilities. For example—to apply in a very 
: eral way the conclusions of the investigators—she may, in 
, ducting classroom games and devices, avoid both 1 and 2 ) 
addends or factors; make only sparing us f 3.4. and 51 y 
e hinations with numbers not over 5; introduce rather frequ 
"| 3. 4. and 5 in combination with addends or factors larger tl 
‘ and bring in most frequently the pairs of addends or fact 
z which 6. 7, & or 9 is combined with any one of these four! . 
Pi bers. There are obviously 16 of these last pairs. Considered 
‘ addends. thev vield 16 addition facts and 16 corresp« nding 
traction facts; considered as factors they vield 16 multipli 
and 16 division facts (to say nothing of 16 partition facts 
the tvpe 1/6 of 42) 
But a teacher may use knowledge of the difficulty of 1 : 
ber facts in still other ways Repetition ts not the sole lay | 
5 learning. We have already spoken of the desirability of ric! 


and more numerous associations during the early presentati 


ry 
| 
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more difficult number facts. Somewhat the same idea may 


carried over into the drill. Each occurrence of a hard com- 
‘on should be singled out for attention. It should be some- 


it should be an event. Thus, each 


t 
¢ more than an incident ; 
Seult number fact should not only occur frequently, it should 


cur vividly and impressively. 

Thus there will always be need for a varied classroom pro 
Here is the teacher's opportunity to supplement the text 
- and to do so in conformity to the difficulty of the elements 
1 this she must know something 


lved. In order to accom} 


ut the difficulty of these elements 
1 discoveries fundamental to the 


Sometimes we become im- 


tient at the slowness with whicl 


into the curriculum of the 


X] ertness of the teacher percolate 
training school. For our part we should far rather have a pros- 
nective elementary-s hool teacher know the | lacement of number 


t< in four or five difficulty groups than to have her gr unded in 
be able to do pretty 


the ratio idea or the Grube me thod., or even to 
and colored yarn 


things with splints, shoe pegs, 


A PROPOSAL FOR A BILL 


The text of the new education bill as it is to be presented to 


of the session is here included The 
the 


Congress on the opening day 
draft has been prepared by the Legislative Committee of 


National Education Ass ‘ciation and the representatin es of other 
a national Department of 


tional organizations which favor 


FE.ducation 


To CREATE A DEPARTMENT OF EDUCATION AND FOR OTHER PURPOSES 


Be it enacted by the Senate and House of Representatives of the 
nited States of America in Congress ass mbled. That there is estab- 


shed at the seat of Government an executive department to be known 


is the Department of Education, which shall be under 
appoint i bv the President, 


‘rection of a Secretary of Education to bé 


Section 158 of the 


and with the advice and consent of the Senati 
Revised Statutes is amended to include the Department of Education 
{ the provisions of Title IV of the Revised Statutes, including all 
endments thereto, shall be applicable to the department. The Secre- 


tary of Education shall cause a seal of office to be made for the Depart- 
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nent of Education of such device as the President shall approve, ar 
iudicial notice shall be taken thereof. 

Section 2. There shall be in the Department of Education an 
ant Secretary of Education, to be appointed by the President, 
to receive a salary equal to that of any other assistant in the De; 
ment. The Assistant Secretary shall perform such duties as may 
prescribed by the Secretary of Education or required by law. Ther 
shall also be a solicitor, a chief clerk, and a disbursing clerk, and 
chiefs of bureaus and such scientific, technical, and clerical assistant 
1s may be necessary to carry out the provisions of this act and as n 


4 


be provided for by Congress from time to time. 
Section 3. (a) The Bureau of Education and all pertaining theret 
transferred from the Department of the Interior to the Department 

f Education 

(hb) The office of Commissioner of Education is abolished, and t! 
authority, powers, and duties heretofore conferred and imposed by 
upon the Commissioner of Education shall be exercised and performed 
by the Secretary of Education. 

(c) The Federal Board for Vocational Education is transferred t 
the Department of Education, and all the authority, powers, and duties 
heretofore conferred or imposed by law upon the Federal Board 
Vocational Education shall be exercised and performed by the Board a 
. division of the Department of Education. The Secretary of Edu 
tion shall be a member of the Federal Board for Vocational Educat 
and ex-officio chairman of said board. 

(d) The authority, powers, and duties conferred and imposed | 
law upon the Secretary of the Interior with relation to the Columb: 
Institution for the Deaf and Howard University, shall be exercised ar 
performed by the Secretary of Education. The Assistant Secretary of 
Education shall be ex-officio a director of the Columbia Institution for 
the Deaf. in addition to the directors whose appointment has heretofor: 
heen provided by law. 

Section 4. (a) Except as otherwise provided by this act, all author 
ity, powers, and duties held, exercised, and performed by the head of 
anv executive department in and over any bureau, office, or branch of 
the Government which is by this act transferred to the Department 
Education, or which is abolished by this act and its authority, powers 
and duties transferred to the Department of Education, or in and over 
any business arising therefrom or pertaining thereto, or in relation t 
the duties performed by and authority conferred by law upon suc! 
bureau. office, or branch of the Government, whether of an appetlats 
or revisory character or otherwise, shall be vested in and exercised anc 
performed by the Secretary of Education. 

(b) All orders, rules, regulations, and permits or other privilege 
which have been issued or granted by any bureau, office, or branch 
the Government which is transferred under the provisions of this 
to the Department of Education, or which is abolished and its authority, 


> 
‘ 
f 
= 
t 
car 
4 
y 


ar 


19265 EDITORIALS 


wers, and duties transferred to the Department of Education, 
which are in effect at the time of the transfer, shall, after the trans 
> so far as they are not in conflict with the provisions of this act 
otinue in effect to the same extent as if the transfer had not occurré 
Section 5. All officers and employees employed in or by any offi 
sreau, or branch of the Government, transferred in accordance with 


provisions of this act to the Department of Education, are trans 
rred to the Department of Education without change in classifi 
r compensation; and the records and property (including office equip- 
nt) are transferred to the Department of Education. 

Section 6. The Secretary of Education shall have charge in 
‘dings and premises occupied by or assigned to the Department 0! 
Education, of the library, furniture, fixtures, records, and other prop 
rty pertaining to the Department or hereafter acquired for use 1n tts 
usiness. Until other quarters are provided, the Department of Educa 
tion may occupy the buildings and premises occupied by the bureaus, 
fices, and branches of the Government which are by this act tran 


} 


ferred to or included in the Department of Education. 

Section 7. In order to coordinate the educational activities car 
d on by the several executive departments, and to devise ways and 
of improving the educational w rk of the Federal Government 


there is hereby created The Federal Conference on Education which shall 
‘consist of one representative and one alternate appointed by the head 
of each department. The Federal Conference on Education shall no 
report as a body to any one department, but each representative shall 
report the findings of The Federal Conference on Education to his own 
department for consideration and independent action 

Section 8. (a) The Department of Education shall collect such 
statistics and facts as shall show the condition and progress of educa- 
tion in the several States and in foreign countries. In order to aid the 
people of the several States in establishing and maintaining more eff 
cient schools and school systems, in devising better methods of organiza- 
tion, administration, and financing of education, in developing 
types of school buildings and in providing for their use, in improving 
methods of teaching, and in developing more adequate ct rricula 
courses of study, research shall be undertaken in (1) rural educa 
(2) elementary education; (3) secondary education; (4) higher e« 
ation; (5) professional education; (6) physical education, including 


7 


al education for the mental!) 


+ 


tion ; 


health education and recreation; (7) speci 
and educationally handicapped; (8) the training of teachers; (9) 1m- 
migrant education; (10) adult education; and (11) such other fields 
1s in the judgment of the Secretary of Education may require attention 
and study. 

(b) The Department shall make available to educational officers in 
the several States and to all other persons interested in education, the re- 
sults of the research and investigations conducted by it, and the funds 
appropriated for printing and binding for the Department of Education 
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the resuits 


> nr 


19260, and at 


sary, is hereby authorized to be appropriated, out of any 


treasury not otherwise appropriated, to the Department of Edu 
for the purpose of paying salaries and the conducting of stu 
investigations, the paying of incidental and traveling expenses 


In conre 


partment and for law books, bor 


the paying of rent where necessary, and for such other purp 

may be necessary to enable the Department of Education to carr 
the provisions of this act. All unexpended appropriations which 
be available at the time when this act takes effect in relation t 


various bureaus, offices, and branches of the Government which 


this act transferred to or included in the Department of Educat 


which are abolished by this act, and their authority, powers, a1 
n, shall becom avalilabl 
‘<ducation and shall be treat 


branches of the Government 


transferred to the Department of Ed 
expenditure by the Department of 


same as if such bureaus, offices, an 


in the laws m the appropriations as part 


been directly name 
the Department of Education. 

Section 10. The Secretary of Education s 
of each fiscal year, make a report in writing to Congress giving 
count of all moneys received and disbursed by the Department of 


hall annually, at the 


cation and describing the work done by the Department He shall 
from time to time make such special investigations and reports as 
be required of him by the President or by either House of Congr 
or as he himself may deem necessary and urgent 

Section 11. This act shall take effect thirty days after its pass 
except that the provisions of this act in relation to the transfer of 
agency from the jurisdiction and control of one officer to he juri 
tion and control of another, or in relation to the transfer of aut! 
powers, and duties from one officer or agency to another, shall t 


effect July 1, 19260. 
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Reviews and Abstracts 


<KLIN, Epwarp E, The Permanence of the Vocational Interest f Juni 
High-School Pupils. Baltimore, Maryland, Johns Hopkins Press, 1924 
59 pp. (Johns Hopkins Studies in Education Monograph, No. § 

The purpose of Dr. Franklin’s study is best stated in his own words: ‘‘ To 
of pupils 


ascertain how permanent and how reliable are the vocational interests 
the junior high schools. The enduring interests of the child are the 
te? 


ntering 
v to his success in life. But when does he acquire, or develop, 


if he already has them when he enters the junior high school, the basis for 


these interes 


the work of that institution is presented. If he does not have them, it is the 
ity of the school to aid him in developing them.’’ 

The entering pupils (grade VII-B) in eight of the ten junior high schools 
¢ Baltimore, are included in the study. In December, 1922, the pupils filled 
t a questionnaire ‘¢devised for the purpose of studying the vocational, recre 
‘tional, subject-matter, and work interests of the pupils.’’ Three follow-up 
juestionnaires were given: the first in May, 1923, a second one in October, 
1923. and a third in December, 1923, one year after the original study. The 


follow-up cards were then compared with the original ones for the purpose of 
letermining the permanence of choices. Dr. Franklin says in his conclusion: 


‘The vocational interests of junior high-school pupils show a high degree of 

ermanence over a period of at least one year and that a critical one. Two 
children out of three have the same preference at the end of the period as they 
ad at the beginning.’’ 

The writer feels that before conclusions can be drawn concerning the 
value of pupils’ vocational choices, studies will have to be made upon a much 
arger scale and over a decidedly longer period of time. Methods will have to 
e developed which will determine with some certainty the vocational interests 
which are behind the various vocational choices which pupils make, and which 
will ascertain more accurately the relationship between vocational interest and 
ability. 

H. B. ALBERTY 


Ohio State University 


Berry, JaMes B. Teaching Agriculture. Yonkers-on-Hudson, New York, 

World Book Company, 1924. 230 pp. 

One who infers from the comprehensive title of this book that it is de- 
signed to cover the entire range of instruction in those fields of knowledge re 
lated to agriculture is in error. The author has wisely limited himself instead 

f attempting to treat the teaching of agriculture in the elementary school, 
the high school, the vocational school, the college, and the graduate school. He 
has endeavored to bring together from educational theory, from his own ex- 
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perience, and from the experience of others, those materials that will be help! 
} in the teaching of vocational agriculture on the seco: dary-school level 
< Mr. Berry has had considerable experience in te aching, and has had ar 
portunity, as the county supervisor of agri ilture in Crawford County, Per 
vania, to follow closely the teaching of others. He has a background 


makes it possible for him to provide many concrete illustrations 
In his emphasis on st asonal sequence, the importance of the home pr 
os the recognition of community conditions in the determination of what is t 
taught, and the use of the farm survey, Mr. Berry will have the sup] 


most of the students of the problems of teaching agriculture on a vocat 


basis in the secondary school. 
The author fails to harmonize his suggested teaching procedures with what 


he formulates as his fundamental conception of the aim of teaching, n: 


#2 ‘*to develop the ability to think purposefully 
the pupil follows a project-study outline furnish 


’? He says: ‘‘In his supery 


study of an enterprise, 
the teacher.’’ For years many suceé ssful teachers have recognized the larg 


opportunity ‘‘to think purposefully’’ that is offered to pupils in devel 


a their own project outlines. 
He states that: ‘‘The purpose of the home project is to demonstrate the 


lly the problems of scientific agriculture aris 


a pupil’s ability to solve successfu 
in connection with an enterprise of the home farm, under life conditions wit 
In the view of many the primary purpose of the hor 


eall forth such ‘* purpos 


: which he is familiar.’’ 
project is not ‘‘to demonstrate’’ but rather to 


ire thinking’’ as will give the learner a large measure of control of a significant 


body of skills, knowledges, and attitudes related to farming. 
1is service will find many specific sug 


The teacher who is just beginning |! 


gestions of a helpful character. He is also very certain to be encourage 
his efforts by the author’s enthusiasm. 
Georce A. WORKS 


Cornell Unwerssty 
"| Harap, Henry. The Education of the Consum er—A Study in Curriculum 


Material. New York, Macmillan Company, 1924. 360 pp. 
i, an analysis 


When the functional approach to the curriculum is use: 
I 


a activities becomes immediately necessary in order to determine the topics 
42 instruction. This analysis may be positive and deal with duties, vocabularies 
2 f routine actions, and so on, or it may be negative and list the difficulties, pr 

. lems, errors, and the like. Some mate rial lends itself to one form of analysis 
wad while some more easily yields to the other. The negative analysis—a listing 


s, errors, or difficulties—is always a shortcut to the positive. 


of problem 
i and different technique. H 


Mr. Harap has adopted in principle a thir 
makes an indirect survey of the needs of consumers of clothing, food, fuel 
shelter. That is, he has selected from multitudinous sources quantitative d: 
concerning the consumption of these materials. These he compares with 
ards of living, and from the comparison of consuming habits 8 


proved stand 
iards he deduces the problems which should concern the 


consuming stan 
riculum builder. 


5 
he tr 
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} 
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The characteristic of the work which first impresses the reviewer is the 
wsness of the sources studied in the s¢ arch for quantitative data bearing 
onsumption. The following represent only a small section of the lit 

ee studied: The Census Reports, the U. S. Bureau of Agriculture year 
ks. Ravmond Pearl’s summaries of food consumption for seven years, U. 8 
+ Commission reports, the monthly data of U. 8. Bureau of Labor Sta 
: the bulletins of the U. S. Tariff Commission, many reports of private 


and the publications of many semi-publie agen 


« like the Russell Sage Foundation and the National Bureau for Economic 


all those interested in edu 


Mr. Harap has performed a valuable service for 
the consumer. The mere collection of all this material is in itself a 


ntribution to the raw material of the curriculum. It is of obvious value 


t) the home-economies teacher. Its presence, however, points clearly to the 
of such material for a ‘‘consumer’s course’’ to be required of both 
ys and girls in the high school. We firmly believe that training in produc- 
vocational education—is necessary. Why is not training for consump 
n equally necessary? The difference between culture and crudeness is not 


matter of how much we purchase but of how wisely we purchase. 


Mr. Harap has made wi le and constant use of quantitative material, and 


this lies the chief excellence of his text, but a careful examination of the 


terial reveals two points at which his methods are subjective. 
I J 


In the first place, from many thousands of pages of reports he has se 


ted perhaps one hundred and fifty pages of material, and he does this with 
it indicating in any specific manner just what his basis of selection is. He 


merely says ‘‘the method here is to gather all the evidence which shows what 


the people actually do in the process of ¢ suming food, clothing, shelter, and 


fuel.’’ (p. 5.) But obviously this evidence cannot be compressed into some 
undred and fifty pages. One is left with the feeling that the author must 
have been unconsciously guided by his conception of certain problems and 


that some other investigator might have selected different material. This 
feeling of uneasiness might have been removed if some objective basis of 


election had been used and described. 
In the second place, the lack of objective criteria seems to the writer also 
to be present to a slight degree in the deduction of the objectives from the 
bits and standards of consumers. The objectives are often wider in scope 


the material warrants if the author were strictly to follow the statement 


le on page 10 ‘‘the quantitative comparison between modes of living and 

jards of living yields eonelusions which become objectives of educational 
tivity.’’ One feels that here again the author had unformulated and un- 
nseious notions of what should be the objectives of each section (in part 


lating the study and in part suggt sted by it) and added them to the ob- 


tively derived objectives. That he recognizes this is of course clear from 


s statement on page 9 that ‘‘usually’’ the comparisons were quantitatively 
termined. It would have been better, however, to have indicated, if possible, 


the supplemental rules which governed their addition. 
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Mr. Harap has labored diligently to produce a fine piece of work for t 


school curriculum. He has made, not the fully respectable two blades of grass 
grow where only one grew before, but a whole field of grass to grow ; 
barren plot in the educational acres 


W. W. CHARTE! 


University of Pittsburgh 


Rt L A Teaching English wm Schools. Boston, Hought 
Mifflin Company, 1924. 155 pp. | Riverside Educational Monographs 
A complete tour of Europe in two months! One day spent in Rome! 


Thirty-six beds in twenty four nights! Such is the suggestion arising 
the reader as he considers this recent addition to the well-known series 
Riverside Educational Monographs. One hundred and fifty-five small pages 


for a discussion of Teaching English in High Schools 


not £ 
allow time and space for a preliminary survey of the requisites of a te: 
and for a final excursion to hear a brief lecture on modern dancing. Ons 
not help contrasting this little book with its brother volume, Professor L 
ard’s English Composition as a Social Problem which deals very speci 
and almost definitely with one carefully selected, important problem in t 
teaching of the vernacular. 


Despite this limitation, however, despite the fact that one looks in 
liseussion of the very vital and insistent question of improving 
h. Teaching English in High Schools is an exes 


pupils’ ever) lay spee 
hook. Nothing very revolutionary; nothing very startling; for the writer 


evidently realizes that progress here demands no great upheaval, no ed 


tional cataclysm, but that rather will it eome largely from doing more 


ectively those things we are already attempting, by pressing on gradual 


but steadily from point to point and consolidating and fortifying the gr 
gained 

The author is closely in touch with the advances which have marked 
hinge of English in the past decade; he has discussed the most importa 


tern 
: ' ef these with a gratifying sanity and clarity. Indeed one feels on ever 
page, the impress of the wide-awake, progressive, thoughtful teacher drawing 


| the «tores of an extended and valuable experience im the classr 


Perhaps the most comme ndable feature of the book is to be found in t! 


many excellent suggt stions for classroom procedure which freight its pages 


Another almost equally excellent feature is the brief summaries of the ad 


vantages and the disadvantages of such matters as the project, the socialized 


recitation, and other innovations which have, of late years, been gaining 4 
foothold in the English class. 

The author has conducted us on a helpful, stimulating, suggestive 
across the field of English. ‘‘ Home-keeping youths have ever homely wits’’ 
so teachers of English and high school administrators should by all 
profit by the many valuable hints and the sound judgment shown in this 


little book 


means 


H. G. Patt 


Uniwersity of Illmotws 
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Graphic Aids in Occupaty al 


1 Teaching. Bruce Publishing Company, Milwaukee, Wisconsin, 1924 


This book has many of the virtues and a few of the disadvantages a 
r hook. Certainly those interested in progressive methods in vocational 

at and guidance will give it car ful attention and many workers will 
it its methods in the classroom 


ve had occupational specifications of many 


edge of the reviewer which have tried to put in graphie form th m 
li livisions oT a trade or a job, at least im 


worked out by Mr. Bowman and his 


It is very questionable whether classes in occupations need su 
228 as are herein elaborated. Vhat is rather nee led Is a clear aqiagram 
the several kinds of workers. There is possibly m this pioneer book ar 


lerive help from a study of 


rT} nsvehologist will d 


f the first attempts to use the graph method extensivel) It 1s p 
for ehildre n who have learned to Visualize, 
other methods of studs 


that the book is more valuable 


than for pupils who prefer 


M. Bri 


Harvard University 


BAILOR, EDWIN M. Content and For in Tests of Intelligence New Y¢ rk, 
; 1924. 74 pp. Teachers College, 


Teachers College, Columbia University, 
‘ol bia Uni ty, Contributions t Edueation, No. 162 


al educational psycholog 


vu the field of 


This is a contribution to theoretic: 
intelligence measurement, particularly as to the validity of the ‘‘ general 
factor’’ theory of intelligence. The a ithor defines content from the point of 


view of this study, as consisting specifically of three kinds: 1) verbal, 
2) nume rieal, and 3 spatial. He defines ‘* form’’ as the objective 0 old in 


which the test is cast. His main argument is based on the inter-correlations of 
tests of 1,039 white boys of high school age, given 15 tests m 


peated one year later. 


The large number of cases, the careful selection of subjects as to age, sex, 
color, residence, and repetition of all tests one year apart, mt ke possible the 
for attenuation, and the 


se of such refined statistical analyses as 


eorrections 
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use of partial coefficients computed from the corrected coefficients. Corre 
for attenuation rules out statistically the factor of different length—of 
time limit of the test. In the larger group the resulting difference in for q 
shown by three coefficients: the corrected coefficient of correlation bet 


numbers and words is, .7614; between numbers and space, 7565; a 


tween words and space, .6797. There is thus no evidence to bear out Spe 


man’s contention of a single, general intellectual factor since validation ¢ 


theory requires each of the above correlations to be 1.00. All indications s 


} + 


gest basic discreteness among intellectual factors. General ability is thus 


made up of a number of discrete or special capacities. The pedagogical 
plication is that there are innate differences in learning rates and limits 
acquirement of differing educational contents. 

The practical conclusion of the res¢ arch for test construction is that 
constructing a seale for measuring any general ability, each test must 
weighted, not equally or arbitrarily, but according to an empirical law, weig 
with a differential regression weight. The need for special-abilities tests, « 
in the measurement of intelligence, is evident 

It is hoped that the author may see fit to publish at an early date all 
intercorrelations, means, and standard deviations of the two givings of tl if 
tests. These, because of the low probable errors and repetition of all test 
would be of inestimable worth for future theoretical studies of man; 
Contrary to one’s expectations, from the titles no light is shed upon the pr 
completion, m ultiple choice, true false 


lem of the form of test—analogies 


wh a given content, for example, arithmetical reasoning pr 


field. 


HERBERT 


Ohio State University 


PACKER, PatL C ig Hriah-School Programs New York, 1 


Te ache rs Colleg 


i ntift lata which will help nerinter nte nda 


factory high-school buildings are very n worth while. A modern 
building should be planned to fit courses of study which will be offer 
inity. School work should not be foreed to conform t 
+} 


give n cor 


Dr. Packer’s study is primarily devoted to the development of a tec! 


which will determine the number of instructional rooms required for 


gram of studies in any compreh¢ nsive high school. A brief sketch is 


showing how high schools have grown in numbers, size, and curricula. 
1 in higt S 


a Sever 


N 


examples are given to show how programs are now being house 


ples are g 
buildings. The study indicates that there is need for more careful planning 


determine 


An analysis of high-school programs was also made to 
high-school building. Four 


number of rooms which should be included in a 


4 
‘ 
| ably be east. The author points out the need for further research it 
A. Toors 
College, Columbia University, 1924. 51 pp 
ss University, Contributions to Edueation, No. 159) 
», 
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ments are given as necessary in order to translate a given program of 
«+ydies into the number of rooms required: (1) the registered number of 
students in the subject, (2) the average number of daily periods devoted to 
the subject, (3) average size of class, and (4) the number of periods in the 
lay. These four factors are used as a means of determining the needed 
rmber of rooms in the following formula: 


Factor 1 X Factor 2 
Number of rooms 


Factor 3 x Factor 4 

Several applications of the formula are made, but more detailed explana- 
» would ba of benefit to the average school superintendent. 

P. R. STEVENSON 


Ohio State University 


Writer, GeorcE W. The Public-School Debt im Illinois. New York, Mac- 
millan Company, 1924. 97 pp. 

Speaking gen rally, this study des ribes and interprets the trends of bonded 

iehtedness for schools in Illinois from 18753 to 1922. Speaking more spe 
ifieally, it diseusses the location of bonded indebtedness, the causes for in 
rensed bonded indebtedness, the outlook for future bonding, the floating of 
ssues, the cost of bonded indebtedness, floating indebtedness, and school 
tedness compared with that of other taxing units, and the probability of 
repayment of the indebtedness. 

Some outstanding findings of the study are: bonded and floating in 
iebtedness have increased very rapidly, particularly in recent years ; indebted 
ess has increased much more rapidly than the total population and school 
attendance: school indebtedness has increased faster than other indebtedness; 
some districts have many times as much indebtedness as others; the high 
hools, and particularly the smaller ones, have far more per pupil indebted 
ness than the elementary schools. 


Some of the outstanding merits of the study are: it 1s timely; it 1s 


isually clearly and interestingly written, particularly for an academic docu 
nent: and it bears the chief earmarks of a scientific document im that it is 
urate, objective, impartial, and verifiable. 
Some things missing that, if present, would add to the value of the 
study are: more interpretations of facts; more data on trends of indebted 
ness compared with trends of real or assessed wealth; some data on the value 


= ool property compared with school indebtedness that is, assets eompared 


with liabilities; and a summary. 
The reviewer believes the study the best treatise that has yet appeared 
he public-school debt of a state. It will be of interest primarily to the 
people of Illinois, but because of its generally applicable technique it will 


also be of interest to students of school finance everywhere. 


Warp G. REEDER 


Ohio State Unwersity 
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QA Rucu. G. M. The Improvement of the Written Examination. Chicago, 8 
Foresman and Company, 1924. 193 pp. 
Although there has been much recent interest in the improvement 
2 aminations, the reviewer believes that this is the first volume entirely dev 
to the topi The author states ‘‘that the function of this book is to sugg 
a methodology of examination construction which is immediately servi 
to the classroom teacher or supervisor.’’ He deals with the functions of w1 
: examinations, the criteria for idging them, the sources of error, and the 
and const tion of the newer objective examinations. He also discusses a few 
4 experimental data and devotes a chapter to pertinent statistical procedu 
oe The experiment in which the author compared st veral types of new 


aminations is interesting and affords valuable data. One regrets, however 


it was not more extensive and also that it did not deal with the completi 
the mat PF = tests R ich concludes that the reeall and the 
: response types ** seem to be superior in every point of view’’ to the true-fals 
w The reviewer believes, however, that since their superiority over the true-fa 
a ‘ bably wise to use the latter occasionally for the s 
: The author states that the newer types of examinations may be s 
structed as to require reasoning as well as mere factual memory, yet sug} 


that the spee d of high-s« hool or college students on a re eall test should be f 


to eight items per minute; on a recognition test, six to ten; and on a 
false test, ten to fifteen. Certainly at these speeds little reasoning can be 
Several statements of doubtful accuracy are to be found. For exa 
Ruch states that ‘‘ measurement is always sampling,’’ again ‘*that an exal 
tion of ten questions, or worse still, five questions is a very § 


the 


Although both statements express general truth 


sampling is evident.’’ 


reviewer does not believe that they always hold. Ina limited field one car 
cure a complete measure of ability. For example, @ test may include al! 
addition combinations of single digits. Likewise ten or even five questions | 
very small sampling if they are topical or in some other w 


| give more than a 
In the chapter on statistical consi 


call for large amounts of material. 
several statements appear which might mislead the tyro. For example, 


stated without any qualifications that ‘‘the standard deviation im ludes 
eent of the total distribution.’’ This is only true for a normal distribut 
se the standard deviation is laid off from the mean. 
inaccuracies, and other faults, the reviewer prt 


late the n 


also in 


Despite its omissions, 
that this volume will be widely read and will do much to stimu 
ment for better examinations. 

C. W. Opt 


University of 
SuzzaLo, Henry. Our Fatth w Education Philadelphia, J. B. Lip} 
Company, 1924. 108 pp. 

As is suggested by the title, this little book is concerned, in the 

A vision of this social sig 


ma& 


with the large social significance of education. 
£ 
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feance, as the author insists, is necessary to sustain the teacher’s faith in 
his calling. Other things are subordinate to it in importance: 
There is a sense in which values are more important than technique. The 
+ skilful mind searcely starts favorably upon the road of important ac 
lishments unless it knows the high significance of its errand. It is by 
the larger relations and dependencies hetween education and the nobler 
of human life that teachers get a footing for their faith in the 


, 
ations 


hings they do. 


This ‘‘high significance’’ stands out prominently when we observe how 


every road to the realization of our national faith and aspiration leads to 


wards education. In education we find the promuse of progressive improva 


ness upon which our faith in popular sovereignty 1s based. Education 1s 


spensable for insuring ‘<fair chance’’ and ‘‘equal opportunity,”’ and 


the training of a national character which will make democracy some 
¢ more than an empty name. It is only by education that we can develop 
eiety in which leadership and followership will be determined by r lation 


the well-being of the whole group, and not by the accident of social status 


blind circumstance. As measured by the standard of social service our 


mon schools are undergoing significant improvement 


The chapter on ‘*Our Higher Schools’’ offers both a defense of higher 


nt 


eation, on the score of the need for trained leadership, and a statement 
the main problems with which the institutions of higher learning are con 

nted. One of these is to bring within their gates all those who are fit for 
vdvanced training. Another is to improve the quality of its teaching, so that 
through good teaching every scientist will become a humanist in a fine 
A third problem is to develop a rigid discipline 


functional sense’’ (p. 100). 
‘¢Bad logic in a class discussion should become as intolerable 
(p. 102). Lastly, there is the problem of 
but its 


f thinking. 
as a discord in a musical studio’’ 


research. ‘‘It is the largest problem before an aspiring university, 


solution waits on the other reforms suggested’’ (p. 105 


A summary of this sort necessarily falls far short of doing justice to 


this book. It fails to transmit the author’s fine enthusiasm, the suggestion 


of wider horizons, and the skill of presentation. The book can be cordially 
but as a means of 


recommended to teachers, not only as a professional tonic, 


furthering their understanding of our public echools as ‘‘the chief supports 


f a democratic system of life organized to give liberty and happiness & 
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